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HOW  TO. . . 

USE  THIS  GUIDE 


The  Coiimiunitv  Survey  Technical  Guide  accompanies  the  Community  Survey 
Handbook.  Its  purpose  is  to  provide  more  detail  on  specific  survey 
techniques,  in  particular  "how  to"  do  the  steps  in  the  process  outlined  in 
the  Handbook. 

The  Technical  Guide  provides  general  guidelines  and  tips  in  carrying  out  a 
survey.  It  is  highly  recommended,  though,  that  you  also  refer  to  other 
resources.  The  library  has  a  variety  of  books  on  all  aspects  of  surveying. 
There  may  also  be  people  in  your  coimnunity  who  have  been  through  the 
survey  process.  They  can  serve  as  excellent  resource  people  and  can 
provide  experienced  guidance  and  advice.  The  appendix  at  the  end  of  the 
guide  lists  other  resource  agencies  you  may  want  to  contact. 

A  community  survey  provides  you  with  good  feedback  on  the  concerns  and 
issues  of  local  residents  and  can  help  you  plan  to  meet  local  needs.  It 
also  brings  community  people  together  to  work  toward  a  common  goal  or 
address  a  specific  problem  or  issue. 

Good  luck  in  undertaking  your  survey. 
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HOW  TO. . . 

SET  THE  TIME  LINES 


A  comprehensive  planning  schedule  is  crucial  to  the  success  of  your 
project.  One  very  effective  method  of  planning  is  through  the  use  of  a 
Gantt  chart. 

The  main  feature  of  the  Gantt  chart  is  that  the  start  and  finish  dates  of 
all  the  tasks  are  depicted  on  an  easy- to- see  time  scale  or  calendar.  You 
can  choose  a  time  scale  according  to  the  number  of  tasks  and  the  length  of 
time  you'll  need  to  do  them.  For  example,  each  column  of  the  chart  can 
represent  a  day  or  a  week.  The  sample  chart  that  follows  is  based  on  the 
timelines  set  by  the  Northview  Community  Recreational  Survey,  as 
identified  on  page  38-39  of  the  Community  Survey  Handbook.  The  horizontal 
line  after  each  task  shows  when  that  task  starts  and  finishes.  Broken 
lines  may  be  used  to  show  work  beyond  the  scheduled  completion  date. 

Every  member  of  the  working  committee  should  be  provided  with  a  Gantt 
chart,  which  they  can  use  to  follow  the  progress  of  the  tasks  they  are 
responsible  for.  A  blank  master  copy  of  a  Gantt  chart  suitable  for 
duplication  follows  on  page  4. 
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HOW  TO . . . 


SELECT  A  SAMPLE 


There  are  three  steps  in  selecting  who  you  should  get  to  answer  your 
questions. 

1.  First    define    your  population.  This  would  be  the  complete  group  of 
people  that  you  are  interested  in  studying. 

2.  Which    people    of    the  group  should  be  asked  the  questions?     This  is 
the  sample :  the  sample  is  a  subset  of  the  population. 

3.  How  should  these  people  be  selected?    This  is  the  sampling  method. 

Depending  on  your  population  size,  you  may  want  to  survey  everyone 
involved.  For  example,  in  the  following  groups,  you  can  contact  everyone 
so  you  don't  have  to  decide  who  to  leave  in  or  who  to  leave  out. 

•  Members  of  your  organization 

•  Your  board  of  directors 

•  Volunteers  in  your  agency 

Samples  and  sampling  methods  are  used  when  you  can't  or  don't  want  to 
survey  every  member  in  the  group.  For  economical  reasons,  data  is  usually 
collected  from  a  smaller  group  rather  than  the  entire  population.  The 
following  situations  would  require  attention  to  both  sample  size  and 
sampling  methods. 

•  Your  neighborhood 

•  Clients  of  your  organization 

•  A  whole  town  or  city 

In  these  cases,  it  is  too  costly  and  time  consuming  to  survey  or  interview 
every  member  of  the  population.  So,  a  sample  is  selected  to  provide  the 
answers.  The  critical  question  is:  how  accurate  is  it  to  generalize  the 
answers  from  your  sample  to  your  population?  If  50%  of  the  sample  say 
they  want  a  swimming  pool,  we  can't  be  certain  it  means  50%  of  the 
population  want  a  swimming  pool.  Obviously,  the  larger  your  sample,  the 
more  accurate  your  results  would  be. 

The  following  chart  is  a  general  guide  to  how  many  people  should  be 
sampled,  based  on  the  population  size. 


Total  Number  in  the  Population 


Sample  Size 


100  or  fewer 


all 


101  to  300 
301  to  500 


2  out  of  every  3  people 
every  second  person 
every  third  person 


501  to  1,000 
over  1,000 


370 
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Let's  look  at  an  example. 

This  case  relates  to  the  scenario  in  the  handbook  about  the  recreation 
survey  in  Northview. 


Population                                         Total  Number  Sample  Size 

Continuing  Education  Board  8  8 

Continuing  Education  Staff  3  3 

Present  participants  of  recreation  courses  71  71 

Past  participants  of  recreation  courses  364  182 
Adults  of  the  community  who  may  take 

recreation  courses  1,430  370 


Now  that  you've  identified  the  number  of  people  in  your  sample,  how  do  you 
select  which  individuals  you  will  survey?  There  are  a  number  of  different 
methods  that  can  be  used,  some  being  more  effective  than  others. 

Accidental  Sample 

This  is  the  weakest  type  of  sample  but  the  easiest  to  get.  A  typical 
accidental  sample  is  the  "man- on- the -street"  interview.  The  interviewer 
asks  whoever  comes  along  and  is  willing  to  talk.  However,  this  can  be  a 
source  of  bias.  For  example,  suppose  you  were  doing  a  community  survey  and 
decided  to  interview  100  households.  If  you  talked  to  whoever  answered  the 
door,  the  sample  would  be  accidental.  Children,  mothers,  fathers  and 
babysitters  could  have  answered  the  door.  But,  depending  on  the  time  of 
day,  it's  possible  the  majority  of  respondents  could  have  been  children  or 
teenagers,  neither  of  whom  represent  the  whole  community. 

Reputational  Sample 

Pvather  than  a  sampling  method,  this  is  more  a  selection  procedure.  Here, 
the  choice  of  who  is  interviewed  depends  on  someone's  judgment  of  who  is 
and  who  isn't  a  "typical  representative"  of  the  population.  Sometimes 
people  are  selected  because  of  their  reputations  or  because  they  are 
publicly  visible  or  because  they  hold  a  particular  position.  Talking  to 
the  presidents  or  executive  directors  of  organizations  is  a  legitimate  way 
to  collect  information  but  no  claim  should  be  made  that  the  views  of  these 
people  represent  the  views  of  the  population. 

Random  Sampling 

In  a  random  sample,  every  member  of  the  population  has  an  equal  chance  of 
being  selected  and  included  in  the  sample.  One  way  to  do  this  is  to 
divide     the     total  number  of  people  in  your  population  (1450)  by  the  sample 
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size  that  you  need  (370).  The  resulting  number  (3.86)  means  your  sample 
would  consist  of  one  in  every  four  people.  Then,  you  would  go  through  the 
list  of  names  choosing  every  fourth  person  until  you  had  370  names.  The 
list  you  use  would  have  to  have  every  member  of  the  population  on  it.  It 
could  be  a  taxpayers  list,  voters  list  or  the  telephone  book. 

Other  Sampling  Methods 

There  are  also  other  methods  of  sampling. 

For  more  information  and  details  on  sampling,  you  may  want  to  refer  to  the 
resource  appendix. 
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HOW  TO. . . 

DESIGN  THE  QUESTIONNAIRE 


Asking:  the  Questions 

As  we  learn  every  day  from  our  own  conversations,  people  don't  always 
answer  the  question  we  think  we  just  asked.  If  we  tape-recorded  our 
conversations  and  then  replayed  them,  we  would  realize  how  unclear  some  of 
our  questions  really  are.  In  conversation,  we  rely  on  a  number  of  factors 
to  understand  meaning:  the  words  used,  how  well  we  know  the  other  person, 
facial  expression,  hand  gestures  and  tone  of  voice. 

With  a  survey  the  questions  have  to  be  clear  enough  to  stand  by 
themselves.  Therefore,  it  is  important  to  choose  words,  phrases  and 
sentence  structure  that  are  commonly  used  by  the  people  who  will  answer 
the  questions. 

Although  there  are  many  ways  of  asking  questions,  a  few  are  used  most 
commonly.     There  are  good  reasons  for  their  common  use: 

•  Most  people  can  understand  the  format  of  the  question 

•  You    can    be    fairly    sure     that    you  know  what  people  mean  by  their 
answers 

There  are  two  main  types  of  questions  that  are  commonly  used  in  personal, 
telephone  and  mail  surveys : 

•  Open-ended  questions 

•  Closed  questions 


Open-ended  Questions 

Example:     What    changes  would  you  like  to  see  in  the  services  available 
at  the  Pinehurst  Centre? 


Open-ended  questions  invite  the  person  answering  the  question  to  give 
whatever  answer  fits  that  person's  situation.  Answers  to  the  above 
question  could  include  anything  from  better  lighting  to  keeping  the 
library  open  on  Saturdays. 
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Guidelines : 


•  Keep  the  questions  short. 

•  Limit  each  question  to  one  idea. 

•  Try    filling    in    your    own    answer  to  see  how  much  space  to 
leave . 

•  Use  open-ended  questions  sparingly. 


The  answers  are  slow  for  interviewers  to  write  down. 
People    tend    to    dislike  the  time  it  takes  to  write  out 
their    thoughts    on    mail    questionnaires.     As  a  result, 
open-ended  questions  are  often  left  unanswered. 
Answers      to      open-ended    questions     are     difficult  to 
analyze . 


Closed  Questions 


A  question  is  closed  when  respondents  must  choose  their  answers  from 
answers  provided.  There  are  three  major  types  of  categories  for  closed 
questions  which  are  illustrated  below  and  discussed  in  this  section. 


1.  Nominal  Type 


Example : 


Were  you  born  between  1919  and  1938? 


YES 


NO 


2.  Ordinal  Type 


Example : 


Please  indicate  your  age  group. 


Adolescent  (age  9-12) 


□ 


Teenager  (age  13-19) 


Adult  (ages  20-39) 


Middle  Age  (age  40-55) 


Senior  (age  60-80) 


Page  10 


3 .  Interval  Type 

Example:        Please  indicate  your  age  group 
n       11-30  years 
I— 1       31-50  years 
^       51-70  years 


Nominal  Type 

Questions  using  a  nominal  scale  have  categories  of  responses  from 
which  to  choose.  Sometimes  there  are  only  two  categories  ("yes"  and 
"no")  and  sometimes  there  is  a  checklist  of  items. 

Nominal  scales  are  generally  used  to  gather  factual  information;  they 
do  not  measure  degree  of  feeling,  relative  strength  of  opinion  or 
frequencies  of  behavior. 


Example : 


Have  you  ever  attended  any  evening  courses  at  Gallagher 
School? 


□ 
□ 


Yes 
No 


Example 


Example 


Are  you  eligible  for  a  government  grant  to  pay  for 
child  care? 


□ 
□ 
□ 
□ 


Yes 
No 

Don ' t  know 
Not  applicable 


Do  you  have  all  the  information  you  need  about  vacation 
spots  in  our  county? 


□ 
□ 

If  no,  what  additional  information  would  you  like' 


Yes 


No 


(Please  fill  in) 
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Example:  What  was  your  main  reason  for  becoming  a  volunteer? 

□ 


□ 
□ 
□ 
□ 


Have  free  time  available 
Wanted  to  do  something  to  help 
Wanted  to  meet  new  people 

Chance  to  learn  skills  that  might  lead  to  a  job 
Other :  


(Please  fill  in) 
Guidelines  for  Nominal  Questions: 


Be  sure  all  possible  responses  are  provided.  Add  "don't 
know",  "not  applicable"  or  "doesn't  matter"  choices  to 
yes-no  questions,  if  these  are  possible  answers. 

Ask  a  follow-up  question  to  either  a  "yes"  or  "no" 
answer  wherever  you  want  to  learn  more  than  how  many 
people  said  "yes"  or  "no"  to  the  question,  such  as  why 
people  said  "yes"  or  "no". 

Be  sure  the  categories  for  response  do  not  overlap, 
such  as  in  the  following  example: 

Which  activity  do  you  do  most  in  your  leisure  time? 

□ 


□ 
□ 
□ 


Skiing 
Skating 
Hockey 
Team  sports 


Because  "team  sports"  is  so  general,  it  overlaps  with 
some  of  the  other  categories  i.e.  hockey. 


Choices  for  the  answer  are  easiest  to  read  when  the 
blanks  for  answers  line  up  vertically.  They  can  be 
placed  either  before  or  after  the  choices. 
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Ordinal  Type 

In  an  ordinal  scale  question,  the  answers  provided  have  a  logical 
relationship  to  each  other.  We  may  not  know  precisely  the  difference 
between  categories  but  we  do  know  it  is  orderly. 

Ordinal  scales  use  categories  such  as: 


□ 

Always 

□ 

Strongly  Agree 

□ 

Poor 

□ 

Often 

□ 

Agree 

□ 

Fair 

□ 

Sometimes 

□ 

Disagree 

□ 

Good 

□ 

Rarely 

□ 

Strongly  Disagree 

□ 

Excellent 

□ 

Never 

□ 

No  Opinion 

One  type  of  ordinal  scale  questions  is  the  "range -of -response 
questions".  Another  word  for  "range"  is  distance.  This  type  of 
question  allows  you  to  give  your  answer  somewhere  between  two  extremes 
such  as  good  and  bad,  or  often  and  never.  The  choices  are  spelled  out 
for  you. 


Example:     How    often    would    you    have  time  to  be  a  parent  volunteer  at 
the  after -school  centre? 


□ 

Twice  a  month 


Once  a  week 

□ 

^  Once  a  month 
n  Not  at  all 


Example:     How    would  you  rate  the  safety  of  crossing  the  street  in  this 
area  for  young  children  walking  to  school? 

^  Excellent 

n  Good 

n  Fair 

I— I  Poor 
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Example:  About  how  many  times  did  you  personally  use  the  community 
centre  last  winter  (from  December  1  to  March  1)?  Please 
check  one  response. 


□ 

More  than 

16  times 

□ 

Between  8 

and 

15  times 

□ 

Between  4 

and 

7  times 

□ 

Between  1 

and 

3  times 

□ 

Not  at  all 

Guidelines  for  Ordinal  Questions: 

•  Provide  at  least  four  or  five  alternate  responses 

•  Ensure  there  are  the  same  number  of  positive  statements  as 
negative  statements.  Keep  the  scale  balanced  to  avoid  bias. 

•  List  the  responses  in  a  logical  order 

•  Ensure  there  are  no  overlapping  categories 

•  Include  all  possible  responses.  The  respondents  who  do  not 
have  an  opinion  or  have  not  made  a  decision  need  a  category. 

•  This  type  of  question  can  be  used  for  interviewing  even 
though  there  are  more  than  three  possible  answers.  Because 
the  answers  are  related,  they  are  easier  to  remember  than  in 
the  checklist- type  example.  Even  so,  the  interviewer  may 
need  to  repeat  the  answer  options  before  the  person 
answering  can  choose  the  answer  they  wish  to  give . 


Interval  Type 

An  interval  scale  not  only  has  a  logical  ordering  like  an  ordinal 
scale,  but  it  also  has  equal  distances  between  each  category. 

Example:     What    do    you    think  the  monthly  operating  cost  for  the  arena 
are? 


"—J  $1,000  -  $1,499 

^  $1,500  -  $1,999 

^  $2,000  -  $2,499 

^  $2,500  -  $2,999 


The  most  common  interval  scales  are  those  dealing  with  age,  income, 
years,  etc. 
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Guidelines  for  Interval  Questions: 

•  Make     sure     that    each  category  is  the  same  size  i.e.   if  your 
first  category  is  1  -  9  then  your  next  must  be  10-19. 

•  Make    sure     there    are    no  overlapping  categories  i.e.  do  not 
have  categories  1-10,  10-20,  20-30. 


Checklists 


A  fourth  type  of  closed  questions  allows  the  respondents  to  make 
several  choices:  checklists.  A  checklist  is  used  when  there  is  more 
than  one  alternative  that  may  be  correct  for  a  respondent. 

Example:     How  did  you  hear  about  this  workshop? 

(Check  all  that  apply.) 

^  Newspaper 

^  Radio 

^  Promotion  brochure 

^  Grocery  bag  leaflet 

□ 


Other 


(Please  fill  in) 


Example:  Some  of  the  activities  of  XYZ  Seniors  Groups  are  listed 
below.  We  would  like  to  know  whether  or  not  you  want  more 
information  about  these  activities . 

I  do  not  I  do  want 

want  more  more 


Current  Events  Discussions 
Day  Excursions 
Volunteer  Grandparents 
Craft  Courses 
History  of  Canada 
Bridge  for  Beginners 
Psychology  Courses 
Modern  Theatre 


information  information 

□  □ 


□  □ 

□  □ 

□  □ 

□  □ 

□  □ 

□  □ 

□  □ 


Guidelines  for  Checklists: 
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•  The  list  should  include  all  possible  answers.  If  it  is  impossible 
to  list  them  all,  the  category  "other"  should  be  provided. 

•  The  list  should  not  include  overlapping  items. 

•  On  mail  questionnaires,  include  the  direction  check  all  that 
apply  for  questions  where  more  than  one  answer  is  possible; 
otherwise,  some  people  will  check  only  one  answer  and  that  could 
mean  either  they  thought  only  one  answer  was  expected  or  they 
only  had  one  answer  to  give . 

•  This  type  of  question  brings  us  to  one  of  the  differences  between 
mail -type  surveys  and  interview- type  surveys. 

A  rule  of  thumb  for  planning  interviewing  is  that  people  can't 
remember  more  than  three  different  choices  of  answer  very 
easily.  Therefore,  the  common  practice  is  for  the  interviewer  to 
ask  the  question  and  then  check  off  the  answers  on  the  survey 
which  are  closest  to  the  ones  given  by  the  person  being 
interviewed,  rather  than  reading  off  all  the  possible  answers. 

In  interview- type  surveys,  a  format  that  is  easy  for  the 
interviewer  to  follow  has  the  interviewer's  words  in  CAPITALS  and 
instructions  to  the  interviewer  in  brackets  ().  The  following 
example  is  the  interview  format  of  the  previous  example. 

HOW  DID  YOU  HEAR  ABOUT  THIS  WORKSHOP?  (Follow  the  answer 
with  a  question:)  WERE  THERE  ANY  OTHER  WAYS  YOU  HEARD  ABOUT 
THIS  WORKSHOP?     (Check  all  answers  given.) 

Newspaper 

Radio 

Promotion  brochure 
Grocery  bag  leaflet 

Other   

(Please  fill  in) 


Example : 

□ 
□ 
□ 
□ 
□ 
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Background  Questions 

Usually  there  are  some  parts  of  a  person's  background  that  help  to  explain 
the  answers  that  he  or  she  gives  to  survey  questions. 

The  answers  to  background  questions  also  make  it  possible  to  describe  the 
people  who  answered  the  survey. 

Because  these  questions  can  easily  offend  by  asking  for  information  that 
is  often  kept  private,  it  is  important  to  ask  only  those  questions  whose 
answers  are  truly  needed. 

The  way  questions  are  worded  can  also  help  to  avoid  offending  people  by 
asking  for  general,  rather  than  specific,  information.  For  example,  you 
can  ask  what  age  group  the  person  fits  into  rather  than  what  their  age  is. 

Here  are  some  standard  ways  of  asking  background  questions. 


Age 


Example : 


Which  age  group  are  you  in? 


under  25 


25  to  45 


46  -  65 


over  65 


Guidelines  to 


"Age"  Questions: 


Adjust  groupings  according  to  the  needs  of  the  survey. 


Avoid  groupings  that  end  in  30s,  40s,  50s,  etc.  Some  people 
don't  like  to  admit  they've  passed  an  age  ending  in  zero. 


Number  groupings  should  not  overlap  as  they  do  in  the 
following  example  because  they  provide  two  choices  for 
people  aged  35. 


25  to  35 


n   35  to  45 
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Location 

Example:     Do  you  live  closest  to 

n  Hythe 

Beaverlodge 

^  Grande  Prairie 
Guidelines  to  "Location"  Questions: 

•  Choices  should  relate  to  the  survey  concern.  Town  quadrants 
(NE,  NW,  SE,  SW) ,  townships,  or  kilometres  from  a  fire  hall, 
for  example ,  may  be  more  appropriate  than  town  names . 

The  following  background  question  topic  areas  can  create  anxiety  and 
should  be  avoided  if  at  all  possible: 

•  Marital  status 

•  Emplojnnent  status 

•  Nationality 

•  Income  bracket 

•  Level  of  education  completed 

Usually  there  is  another  way  of  asking  what  you  actually  want  to  find  out 
instead  of  asking  for  any  of  the  above  personal  information  directly.  For 
example,  do  you  really  need  to  know  if  a  person  is  employed  or  is  the 
question  you  need  answered,  "Did  you  find  a  job  after  you  finished  your 
training  program?" 
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HOW  TO. . . 

DESIGN  THE  QUESTIONNAIRE 

Wording:  the  Questions 

There  are  a  number  of  factors  to  keep  in  mind  when  you  are  designing  your 
questionnaire.  The  following  points  highlight  key  areas  to  be  aware  of  as 
you  write  your  questions. 

Loaded  Words 

"Loaded"  words  or  phrases  are  ones  that  stir  up  immediate  positive  or 
negative  feelings.  "Drugs",  "strikes",  and  "vandalism"  are  loaded  words. 
When  loaded  words  are  used  in  questions,  people  react  more  to  the  words 
than  the  issue  the  question  is  addressing. 

When  loaded  words  are  used,  the  researcher  does  not  know  what  part  of  the 
question  the  respondent  is  reacting  to.  Consider,  for  example,  the 
following  question: 

Example:     If  there  was  an  election  tomorrow,  who  would  you  vote  for? 

^     Sam  Smith,  our  present  mayor 

^     John  Jones,  the  present  challenger 

If  respondents  are  not  familiar  with  the  candidates,  they  may  be 
influenced  by  generalized  attitudes.  Some  might  indicate  Sam  Smith 
because  they  favour  stability,  experience  in  a  job,  etc.  Others  may 
choose  John  Jones  because  they  are  in  favour  of  change,  or  because  they 
S3niipathize  with  an  underdog,  or  for  other  reasons  not  directly  related  to 
the  candidate  himself.  The  information  provided  wouldn't  be  helpful 
because  you  would  not  know  what  part  of  the  question  is  being  responded 
to. 

Often  the  names  of  organizations,  political  parties,  people  or  groups  are 
"loaded".  When  a  question  starts  with  a  phrase  such  as,  "Doctors  say...", 
some  people  will  be  drawn  to  agree  just  because  they  trust  what  doctors 
say.  Others  will  disagree  simply  because  they  are  skeptical  about 
medicine  and  doctors. 

To  ensure  your  questions  are  clear  and  unbiased,  you  should  always  test 
them  with  a  small  group  before  you  actually  use  them.  How  to  do  a 
pre-test  is  discussed  later. 
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Loaded  Questionnaires 

When  all  the  questions  in  the  questionnaire  are  written,  the  questionnaire 
as  a  whole  should  not  reflect  a  bias  on  any  issue.  Each  section  of  the 
questionnaire  should  be  neutral.  To  do  this,  both  sides  of  an  issue 
should  be  asked  about,  the  positive  and  negative  features  of  a  program 
should  be  addressed,  and  on  important  issues,  questions  should  be  asked 
from  both  a  positive  and  a  negative  perspective. 

You  also  need  to  provide  balance  when  you  use  open  questions.  Always  ask 
at  least  one  question  on  each  side  of  an  issue  or  idea.  The  examples 
below  could  be  used  in  mail  questionnaires  or  in  telephone  or  personal 
face -to -face  interviews. 

•  What  are  the  strengths  of  the  provincial  association?  

•  What  are  the  weaknesses  of  the  provincial  association?  

•  As    you    see     it,     what    factors    have  contributed  to  the  success  of 
program  X?  

•  As    you    see    things ,     what    factors    have    blocked    program    X  from 
success?  

•  What  do  you  hope  happens  at  our  conference?  

•  What  do  you  hope  does  not  happen  at  our  conference?  

Leading:  Questions 

People  sometimes  respond  to  questions  on  the  basis  of  what  they  think  is 
the  interviewer's  answer,  or  on  what  is  the  socially- desirable  answer. 
These  responses  happen  because  of  the  human  tendency  to  want  to  look 
socially- acceptable ,  successful,        knowledgeable,         fair,  helpful, 

intelligent,  a  good  citizen.  This  tendency  is  so  strong  that  people  are 
reluctant  to  admit  they  don't  know  the  answer  to  a  question,  or  that  they 
don't  do  things  they  say  others  should.  On  questionnaires,  people  will 
tell  you  they  voted  in  the  last  election,  brush  their  teeth  twice  daily, 
buy  church  raffle  tickets,  read  the  daily  papers,  enjoy  the  best- selling 
books,  etc.     Often  these  answers  are  not  exactly  true. 

The  way  we  ask  our  questions  can  lead  the  response. 

Example:     Are  you  in  favour  of  extending  services  to  seniors? 

Example:     How    much    time    did  you  devote  to  your  child's  homework  last 
week? 


Page  20 


To  disagree  with  the  first  question  is  like  voting  against  motherhood. 
The  second  question  not  only  assumes  the  respondent  did  spend  some  time  on 
the  child's  homework,  it  also  uses  a  loaded  word  "devote".  For  some 
respondents  to  answer  "I  did  not  spend  any  time"  would  almost  be  admitting 
"I  am  not  devoted  to  my  child". 

Vagxie  Words  and  Phrases 

This  is  a  tricky  area  because  sometimes  you  want  to  be  deliberately  vague 
to  explore  ideas.  At  other  times,  vagueness  will  be  confusing  to  the 
respondent  and/or  the  results  will  be  confusing  to  the  interviewer. 

The  following  are  some  common  vague  phrases  that  should  not  be  used. 

Example:     How    often    have    you  used  the  Information  Centre  in  the  last 
month? 


□ 

Sometimes 


Never 

□ 


n  Often 
^  Always 

The  categories  of  response  for  this  question  are  too  vague.  Also,  the 
word  "you"  may  be  taken  to  mean  "you,  personally",  or  "you  and  your 
family".  When  the  word  "you"  is  used,  always  specify  to  whom  it  refers. 
Here's  a  better  way  to  ask  the  same  question. 

Example:     In    the    last    two  months,  how  often  have  you  personally  used 
the  Information  Centre? 

n   I  NEVER  HAVE 

n   I  HAVE  USED  IT  LESS  THAN  TWO  TIMES 
n   I  HAVE  USED  IT  THREE  TO  FOUR  TIMES 
n   I  HAVE  USED  IT  MORE  THAN  FOUR  TIMES 
If  the  question  refers  to  a  specific  time,   it  is  wise  to  specify  it. 

•  "1989"  instead  of  "in  the  last  year" 

•  "July  and  August"  instead  of  "During  the  summer" 

•  "6:00  p.m.   on"  instead  of  "Evenings" 

•  "A  few  times .   once  a  month" .   etc.,   instead  of  "Rarely, 

Never,  Often" 
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Complex  Questions 

Sometimes  you  can't  remember  what  you  did  last  week,  yet  surveys  have  been 
known  to  ask  people  to  remember  details  from  last  year.  Some  types  of 
detailed  information  are  hard  to  get. 

Example:     How    many  books  did  you  borrow  from  the  Public  Library  during 
1989? 

  books . 


Many  respondents  will  not  be  able  to  remember  this  information.  The 
questions  are  so  mentally  demanding  that  respondents  may  develop  negative 
feelings  about  completing  the  questionnaire  or  interview.  The  question 
would  be  better  phrased  as  a  series  of  closed  questions. 


Example : 


1.  Have    you  borrowed  any  books  for  yourself  or  your  family  from 
the  Public  Library  since  January  1989? 

^  YES  --  please  answer  question  2 

1—1  NO         please  go  directly  to  question  4 

2 .  Approximately  how  many  books  have  you  borrowed? 

□ 


□ 
□ 
□ 
□ 


LESS  THAN  10  BOOKS 
10  TO  20  BOOKS 
21  TO  30  BOOKS 
31  TO  40  BOOKS 
MORE  THAN  40  BOOKS 


Mentally- taxing  questions  often  appear  when  surveys  want  to  know  how 
people  spend  money  and  time,  or  details  of  their  past.  This  places 
unnecessary  demands  on  the  respondents  unless  questions  are  sequenced  in 
an  order  that  helps  them  recall  and  answer  sequential  pieces  of 
information  involved  in  the  question. 


Checklists  that  are  too  long  and  ranking  questions  with  more  than  eight  to 
ten  items,  place  heavy  demands  on  respondents.  Similarly,  a  long  series 
of  attitude  questions  will  tax  respondents .  With  these  types  of 
questions,  even  an  interested,  willing  respondent  can  suffer  mental 
fatigue  and  be  unable  to  give  full  attention  and  consideration  to  each 
item  or  question.  When  this  happens,  "No  Response"  and  "Don't  Know" 
answers  increase  and  the  quality  of  information  you  receive  is  low. 
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Offensive  or  Threatenin]g  Questions 

Some  questions  can  offend  respondents  so  much  that  they  may  answer 
dishonestly  or  even  refuse  to  answer  the  question.  One  reason  they  may  be 
offended  is  that  a  personal  question  may  be  seen  as  an  invasion  of 
privacy.     For  some  people,   the  following  may  be  an  offensive  question. 

Example:     Have     any  of  your  children  been  involved  in  acts  of  vandalism 
(destruction  of  public  and  private  property)? 


These  questions  can  be  asked  in  a  less  objectionable  way  by  either 
providing  an  introduction  or  background  to  soften  the  question  or  asking  a 
series  of  questions  starting  with  general  opinion  questions. 


□ 


Yes 


No 


Example 


1. 


As  you  may  know,  there  is  some  discussion  about  vandalism  in 
this  community,  and  there  are  questions  as  to  how  it  should  be 
handled.  Some  people  feel  it  is  a  serious  problem:  others 
feel  it  is  not  a  serious  problem.  How  about  your  opinion?  Do 
you  consider  vandalism  to  be  a  serious,  moderate,  slight,  or 
no  problem  in  this  community?  (Check  off  the  box  beside  your 
answer . ) 


SERIOUS  PROBLEM 


MODERATE  PROBLEM 


SLIGHT  PROBLEM 


NOT  A  PROBLEM 


NO  OPINION 


2. 


During  the  last  few  years,  do  you  think  the  incidence  of 
vandalism  has  increased,  stayed  the  same,  or  decreased  in  this 
community? 


INCREASED 


STAYED  THE  SAME 


DECREASED 


□ 


NOT  KNOW 


Page  23 


3.  Do    you    personally    know    anyone    who    has    been    involved  in 
destroying  public  or  private  property? 

□  Yes 

□  NO 


4.  Have    your    children  ever  been  involved  in  destroying  public  or 
private  property? 

□  Yes 

□  NO 


Inappropriate  Questions 

Perhaps  the  most  costly  error  of  all  in  writing  questionnaires  occurs  when 
the  researcher  has  forgotten  or  overlooked  the  purpose  of  the  research  and 
the  specific  information  that  needs  to  be  collected.  This  frequently 
occurs  when  people  jump  into  writing  questionnaires  before  clarifying  how 
the  responses  will  be  used.  When  this  happens,  a  lot  of  information  might 
be  collected  that  is  "nice  to  know"  but  not  necessary  or,  even  worse,  the 
needed  information  might  be  missing. 

Each  question  used  should  have  an  explicit  rationale  for  being  in  the 
questionnaire.  You  must  know  why  the  question  will  be  asked  and  what  will 
be  done  with  it. 


Page  24 


HOW  TO. . . 

DESIGN  THE  QUESTIONNAIRE 


Ordering  t^e  Questions 

Once  you  have  designed  the  questions  to  get  the  answers  you  need,  it  is 
important  to  ensure  the  questions  are  in  a  logical  sequence  and  are  easy 
to  follow. 

•  Organize  the  survey  by  grouping  the  questions  related  to  each 
topic.  Deal  with  one  topic  at  a  time. 

•  Aim  for  a  logical  flow  from  one  question  to  the  next  where 
possible.  For  example,  ask  whether  people  have  pre  -  school -  aged 
children  before  asking  whether  they  need  day-care. 

•  Start  with  simple  questions  that  are  easy  to  answer  to  arouse 
interest.  Go  from: 

-  General  questions  to  specific  questions 

-  Easy  questions  to  difficult  questions 

-  Impersonal  questions  to  personal  questions 

•  Place  background  questions  last  in  the  survey.  That  way,  any 
negative  feelings  about  the  background  questions  do  not  carry 
over  into  answers  to  the  main  questions. 

•  For  "GO  TO"  instructions  where  people  are  directed  to  skip 
questions  if  a  topic  does  not  relate  to  them  (see  example) ,  be 
sure  the  numbers  people  are  directed  to  are  correct.  Question 
numbering  can  easily  get  confused  during  the  revising  stage. 

Example:  Do  you  have  any  family  antiques  to  contribute  to  the 
museum  collection? 

n  NO  (GO  TO  question  13) 

I  YES  (GO  TO  next  question) 

•  Identification  of  the  person  giving  the  answers  is  handled  in 
one  of  two  ways.  You  can  either  use  identification  numbers 
placed  in  the  upper  right-hand  corner  of  the  first  page  or  ask 
the  person  to  give  their  name  and  phone  number  or  address  at  the 
end  of  the  survey.  Since  people  will  feel  freer  to  answer  with 
an  identification  number  than  with  their  name  on  the  survey,  only 
ask  for  names  if  you  must  have  them  for  some  reason. 
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HOW  TO. . . 

DESIGN  THE  QUESTIONNAIRE 


Laying  out  the  Questions 

The  final  touches  to  your  questionnaire  revolve  around  how  it  is  laid  out, 
A  survey  that  looks  good  and  looks  professional  will  get  a  higher  response 
rate  than  one  that  looks  poor.  The  survey  also  creates  a  first  impression 
of  the  community  group,  so  plan  carefully.  The  following  points  may 
provide  you  with  some  tips . 

Organization 

Personal  and  Telephone  Interviews 

Personal  or  telephone  survey  forms  generally  have  the  introduction  on  the 
first  page  of  the  survey. 

The  introduction  should  include: 

•  The  interviewer ' s  name 

•  The    title    of    the    survey,  the  group  who  are  having  it  carried  out 
and  the  reason  the  survey  is  important 

•  Who    is    being    asked  to  answer  the  survey  and  if  their  answers  will 
be  confidential 

•  Approximately    how    long  the  interview  will  take  and  whether  this  is 
a  good  time  for  the  interview 

A  cover  page  for  interviews  is  helpful  for  both  the  interviewer  and  the 
survey  manager  to  keep  track  of  progress  on  each  interview.  It  can 
include : 

•  Name  of  the  interviewer 

•  Name  and  address  or  phone  number  of  the  person  to  be  interviewed 

•  Day  and  time  of  first  contact  if  necessary 

•  Day  and  time  of  second  or  third  contact  if  necessary 

•  Space  for  a  suggested  call  back  time 

•  Final    interview  status:  completed,  refused  or  no  answer  after  three 
attempts 

•  Identification    numbers    of  people  who  are  interviewed  should  appear 
both  on  the  cover  page  and  on  the  interview  form 
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Mail  Questionnaire 

A  mail  survey  package  includes: 

•  An  introduction  or  introductory  letter 

•  The  survey  letter  itself 

•  A  stamped,  addressed  return  envelope 

An  introductory  letter  can  carry  a  lot  of  weight,  especially  if  it  is 
printed  on  letterhead  and  is  signed  by  the  head  person  who  has  access  to 
the  letterhead.  This  could  be  the  director  of  an  agency,  the  mayor  of  a 
town  or  the  president  of  a  society. 

Information  to  include  in  the  introduction  would  ideally  be: 

•  The     title  of  the  survey,   the  group  who  is  having  it  carried  out  and 
the  reason  the  survey  is  important 

•  The  purpose  of  the  survey  and  the  importance  of  participation 

•  Who     is    being    asked  to  answer  the  survey  and  if  their  answers  will 
be  confidential 

•  When    the     survey    will    be    completed,     where     the    results  will  be 
available  and  what  it  will  be  used  for 

•  Deadline  for  mailing  back  completed  surveys 

•  Name    and    phone    number    of    the  person  to  contact  if  there  are  any 
questions 


Length 


•  The  ideal  mail  out  survey  is  two  to  four  pages  long.  A  shorter 
survey  may  not  appear  serious  enough  to  answer.  A  longer  survey 
may  be  set  aside  for  answering  at  another  time. 

•  Back- to-back  printing  makes  the  survey  seem  shorter,  but 
sometimes  people  omit  filling  in  the  backs  of  one  or  more  pages. 

•  Reducing  the  size  of  the  print  to  get  more  questions  on  a  page 
only  works  to  make  the  survey  seem  shorter  if  the  print  is  still 
easy  to  read  and  if  there  is  adequate  space  for  filling  in 
answers , 
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The  best  solution  to  a  long  survey  is  to  review  the  questions  and 
remove  the  ones  whose  answers  will  provide  the  least  help. 


Type 

•  Type  should  be  easy  to  read.  Size  of  type,  space  between  lines, 
and  clear  type  all  influence  how  easy  a  page  is  to  read.  Leave 
lots  of  white  space. 

•  Use  underlining,  capitals,  boldface,  double  and  single  spacing  in 
a  consistent  way  to  set  apart  instructions,  questions  and  spaces 
for  answers . 

•  Leave  adequate  space  for  answers.  Check  by  completing  a  copy  of 
the  survey  yourself. 


Printing 

•  Print  10  -  15%  more  surveys  than  you  plan  to  use  so  you  have 
extras  for  call  backs,  etc. 

•  Choose  paper,  type  and  copy  method  carefully,  particularly  for 
mail  out  surveys . 

•  If  you  have  the  budget,  have  your  questionnaire  copied  by  a 
professional  printer.  This  will  add  to  the  look  of 
professionalism  of  your  form. 
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HOW  TO . . . 

CONDUCT  THE  PRE -TEST 


Whatever  form  of  questionnaire  you  will  use,  you  can  be  sure  of  one  thing: 
it  will  need  corrections  and  revisions  to  make  it  work  effectively.  A 
pre -test  is  an  evaluation  of  the  questionnaire  before  it  is  used  to  ensure 
its  effectiveness.  You  could  be  under  strict  timelines  and  feel  you  can't 
afford  the  time  to  pre -test;  in  that  case,  you  may  want  to  re -evaluate 
whether  or  not  you  should  conduct  a  survey.  A  survey  tool  that  is  not 
effective  is  not  much  use.  It  is  important  to  take  the  time  and  ensure  you 
are  getting  reliable  and  valuable  information. 


A  pre -test  will  address  a  number  of  questions: 


1.  Can    the     instructions    be  followed  as  they  stand  or  do  they  require 
further  explanation? 

2 .  Are  all  the  questions/words  understood? 

3.  Are  there  any  questions  that  are  unclear  or  confusing? 

4.  Do  the  questions  ask  what  they  are  intended  to  ask? 

5.  Are     the  questions  interpreted  as  they  were  intended  and  interpreted 
similarly  by  all  respondents? 

6.  Are    there  questions  people  do  not  know  how  to  answer  or  do  not  wish 
to  answer? 


7.  Do     the    questions     seem    relevant    to    the  problem  or  issue  you  are 
studying? 

8.  Does  there  appear  to  be  any  bias  in  the  questions? 

9.  Does     the     questionnaire     create     a  positive  impression  and  motivate 
people  to  answer  it? 

10.  How  much  time  is  required  to  complete  the  questions? 

Four  types  of  people  should  take  part  in  scrutinizing  the  questionnaire 
during  the  pre -test: 


•  Colleagues 

•  Research  experts 

•  Potential  users  of  the  data 

•  Cross -section  of  potential  respondents 
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The  first  three  groups  can  provide  valuable  feedback.  Your  colleagues  can 
comment  on  how  well  the  questions  accomplish  the  study  objectives.  Experts 
in  the  field  of  research  may  have  suggestions  that  could  increase  the  rate 
of  response  or  clarify  any  question  areas  that  appear  vague.  Potential 
users  of  the  information  would  have  thorough  knowledge  of  the  topic  area 
and  could  check  for  accuracy  and  lack  of  bias. 

At  this  point,  you  will  have  checked  your  questionnaire  with  a  small  group 
of  people  who  are  willing  to  help  and  you  have  probably  made  some  changes 
and  revisions.  This  is  not  enough.  NEVER  assume  that  because  you  and  your 
colleagues  understand  your  questionnaire,  that  your  respondents  will  too. 
Colleagues  and  friends  are  well-meaning  but  (a)  they  are  too  kind;  (b) 
they  are  not  the  same  as  the  people  in  your  sample;  and  (c)  they  may  have 
heard  you  discuss  your  study,  which  would  help  them  understand  your 
questions. 

A  pre- test  with  potential  respondents  is  critical.  It  can  examine  any 
areas  on  the  questionnaire  that  may  confuse  the  respondent  and  can  suggest 
and  raise  points  that  perhaps  were  overlooked.  You  will  want  to  pre- test 
with  a  small  sample  of  perhaps  20  to  100  people,  depending  on  the  sample 
size  of  the  main  survey.  This  random  sample  should  be  similar  to  the 
actual  sample  population  and  include  people  who  know  nothing  about  the 
survey  background. 

Contact  each  of  the  people  by  telephone  first  to  explain  the  help  you  need 
from  them,  and  ask  for  their  assistance.  Conduct  the  survey  as  you  plan 
to,  either  by  personal  interview,  telephone  interview  or  by  mail.  After 
the  survey,  ask  for  their  reactions  and  spend  time  getting  answers  to  the 
above  questions.  In  the  mail-out  questionnaire,  you  can  either  follow-up 
with  a  phone  call  to  the  respondent  or  leave  room  on  the  form  for  people 
to  provide  their  comments. 

When  analyzing  the  results  of  the  pre -test,  look  for  questions  with  a  high 
degree  of  consensus,  large  numbers  of  "don't  know"  or  "no  opinion"  answers 
and  incomplete  answers.  Eliminate  or  revise  these  questions  for  the  final 
draft. 

After  doing  the  pre -test,  use  your  feedback.  Go  back  to  the  drawing 
board.  Revise  and  clean  up  the  form.  If  substantial  changes  were  made 
from  the  first  draft,  do  a  second  pre -test  on  the  second  draft. 

To  summarize,  pre -testing  includes  the  following  steps: 

1.       Obtain    feedback    on    the    draft    questionnaire     from  colleagues, 
research  experts  and  those  who  will  use  the  data 


2. 


Revise  the  draft 
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3.  Present  the  questionnaire  to  a  small  sample  of  potential 
respondents  in  the  manner  you  plan  to  use,  such  as  mail, 
telephone  or  in-person 

4.  Obtain  comments  from  the  respondents 

5.  Revise  the  questions  that  caused  difficulty 

6.  Re-test 

7 .  Prepare  final  draft 
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HOW  TO. , . 

TRAIN  THE  SURVEYORS 

Whether  your  plans  are  for  telephone  surveying,  personal  interviewing  or 
door- to -door  surveying,  the  surveyors  require  some  training  to  understand 
the  survey  process.  It  is  important  that  they  know: 

•  The  survey  background 

•  The  survey  objectives  and  purpose 

•  General  information  on  the  sponsoring  organization 

•  What  to  expect  in  the  field 

•  How  to  answer  questions  from  respondents 

Appendix  D  has  a  list  of  helpful  hints  for  surveys  that  were  used  during  a 
community  survey  in  Beaverlodge . 

Mail  Questionnaires /Drop -Off  -  Pick-Up  Questionnaires 

In  these  types  of  surveys,  there  is  minimal  contact  between  the  respondent 
and  the  individual  who  mails  or  drops  off  the  form.  The  questionnaire 
administrators  must  still  be  able  to  provide  information  on  the  general 
points  noted  above  in  case  of  queries. 

Telephone  and  Personal  Interviews 

The  interviewers  in  these  types  of  surveys  must  have  well -developed 
interpersonal  skills.  They  should  be  pleasant  and  have  good  listening 
skills . 

Before  selecting  your  interviewers,  you  may  want  to  interview  them  to  see 
them  operate  in  a  situation  similar  to  what  they  will  be  asked  to  do.  Talk 
to  a  potential  telephone  surveyor  on  the  telephone  to  get  an  idea  of  voice 
and  manner.  All  interviewers  will  need  to  be  politely  persistent. 

Both  telephone  and  in-person  interviewers  will  need  to  have  a  training 
session.  The  training  should  include  information  in  the  general  points 
noted  previously,  as  well  as: 

•  The  nature  of  the  survey  and  its  purpose 

•  What  the  results  will  be  used  for 

•  How  the  sample  was  selected 

•  How  long  the  survey  should  take 

The  surveyor  will  need  to  be  intimately  familiar  with  the  questionnaire. 
Go  through  the  form  thoroughly,  ensuring  the  questions  and  coding  sheets 
are  understood.   Identify  the  types  of  answers  that  could  come  up. 
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The  training  should  include  practical  situations  -  both  through  role  plays 
and  actual  interviews  in  the  field  with  people  similar  to,  but  not  the 
same  as,  the  sample.  It  is  very  convenient  to  combine  interviewers 
training  and  practice  with  the  pre -testing  of  the  questionnaire. 

In  the  practice  interviews ,  you  may  want  to  bring  in  extra  people  so  that 
each  interviewer  will  have  someone  with  whom  to  practise.  Give  the 
interviewers  your  questionnaire  and  have  them  conduct  the  interview  as  if 
it  was  the  real  situation.  If  possible,  record  the  interview  or  arrange 
for  someone  to  observe  each  interview. 

There  are  specific  speech  behaviors  to  watch  and  listen  for: 

•  Tone  of  voice 

•  Speed 

•  Energy  level 

•  Clarity 

These  "cues"  will  often  influence  the  respondent  without  the  interviewer 
or  respondent  realizing  it.  If  your  interviewers  skip  across  some 
questions  and  linger  over  others,  it  is  important  to  find  out  why  this 
happens.  Are  some  questions  boring  to  the  interviewer?  Do  some  questions 
cause  embarrassment  or  anxiety?  The  interviewer's  attitudes  and  feelings 
can  be  communicated  quite  subtly  and  they  will  influence  the  respondent. 
There  is  nothing  more  discouraging  than  finding  out  after  the  study  is 
over  that  your  respondents  were  influenced  by  the  interviewer  and  your 
research  results  are  biased. 

Check  for  leading  statements  and  fast  closure.  Interviewers  -  sometimes 
unknowingly  -  shape  the  respondents'  answers  either  by  suggesting  answers 
they  personally  favour  or  by  moving  quickly  to  the  next  question  when  they 
hear  something  they  don't  favour.  These  influences  are  often  nonverbal. 
The  interviewer  may  unwittingly  "reward"  some  responses  by  smiles,  nods  of 
agreement,  or  change  in  tone  of  voice.  They  may  "punish"  other  responses 
by  simply  not  reacting,  by  puzzled  looks,  or  by  sighs. 

Note  what  the  interviewer  writes  down  compared  to  what  the  respondent 
said,  based  on  tape  recordings  or  what  the  observer  saw.  If  an 
interviewer  is  asked  to  record  exactly  what  the  respondent  said,  verbatim, 
then  notes  that  just  give  a  sense  of  what  was  said  will  not  be  good 
enough.  What's  left  out  of  an  interviewer's  records  might  actually  be  a 
source  of  bias.  What  an  interviewer  adds  (thinking  it  was  said,  or  trying 
to  clarify  what  the  respondent  meant)  is  also  a  source  of  bias. 
Sometimes,  in  comparing  two  records  of  the  same  interview,  you'll  discover 
the  interviewer  has  systematically  -  but  unconsciously  -  distorted  what 
was  said  to  fit  what  he  or  she  thinks  the  question  means  or  what  the 
respondent  meant. 
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Sometimes  the  interviewers  fail  to  record  something  because  they  think  the 
information  is  so  basic  it  can  be  taken  for  granted.  All  these  behaviours 
will  distort  the  information  collected. 


Check  that  interviewers  understand  how  to  probe  for  more  information  and 
how  to  clarify  responses.  Give  them  examples  of  neutral  probes  like 
"Could  you  say  more  about  that..."  "I'm  not  certain  I  got  exactly  what 
you  meant.  Could  you  tell  me  again?"  or  "May  I  repeat  what  I  wrote  down 
so  you  can  check  that  I  have  everything  you  want  to  say. . ." 

Training  interviewers  is  critical  to  the  success  of  your  study.  It's  also 
important  that  you  supervise  them  on  a  regular  basis  to  check  if  they  are 
having  any  problems,  and  to  read  their  completed  interviews. 

Practice- interviewing  should  give  interviewers  an  opportunity  to  deal  with 
such  typical  statements  as: 

•     I  don't  know  about  the  topic  so  please  interview  someone  else. 

The    interviewer    should    not  contradict  the  respondent,  but  should 

reply,     "The    focus    of    this  survey    is    how  people  feel  about  ABC 

rather    than    what    they  know.  Whatever  information  you  can  give  us 

will  be  helpful.  Perhaps  if  I  read  you  a  couple  of  questions, 
you'll  know  what  I  mean. . ." 


•     I'm  too  busy 


The  interviewer  should  acknowledge  that  he  or  she  may  have 
interrupted  the  respondent,  explain  how  long  the  interview  will 
take,  and  ask  when  to  call  back.  It  would  be  preferable  if  the 
interviewer  could  call  ahead  to  set  up  an  interview  time  that  is 
convenient.  Explain  how  long  the  survey  should  take  so  the 
respondent  can  schedule  the  time. 


•  I  don't  believe  in  surveys. 

The  interviewer  should  acknowledge  that  sometimes  surveys  take  a 
long  time  and  no  one  sees  the  results,  and  then  repeat  how  the 
results  will  be  used,  the  importance  of  the  study,  and  offer  the 
respondent  feedback  from  the  study. 

•  That  question  is  ridiculous. 

The  interviewer  should  not  dismiss  the  respondent's  comment  or  rush 
on  to  the  next  question.  Instead,  record  the  respondent's 
comments,  criticisms,  and  suggestions,  and  assure  the  respondent 
that  his  or  her  comments  are  being  taken  seriously.  In  fact,  if 
the  early  returns  of  a  study  show  a  lot  of  criticism,  anger,  or 
anxiousness,  researchers  should  review  the  interviewer's 
introductory  comments  and  the  questions  being  asked. 
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•  This     is     an     invasion    of    my  privacy.     It's  nobody  else's  business 
what  I  think. 

The  interviewer  should  describe  and  clarify  the  measures  that  have 
been  taken  to  ensure  confidentiality  and  that  names  do  not  appear 
on  the  questionnaire. 

•  Who  is  sponsoring  this  research? 

The  interviewer  needs  to  know  what  to  say  about  the  sponsoring  and 
funding  agency.  In  market  research,  it  is  often  important  not  to 
identify  the  specific  company  that  is  asking  for  the  information, 
so  a  broad  term  is  used,  for  example,  "Ski  areas  want  this 
information"  or  "An  agency  working  with  volunteers"  might  be  used. 

Sometimes,  typical  respondent  statements  and  the  appropriate  interviewer 
responses  are  typed  out  and  given  to  interviewers.  This  back-up  material 
will  help  the  interviewer  to  feel  prepared  and  supported.  In  addition, 
interviewers  should  have  written  information  on  the  purpose  of  the  study, 
who  respondents  can  call  for  further  information,  how  respondents  were 
chosen,   and  if  and  when  a  copy  of  the  results  will  be  sent  to  respondents. 
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HOW  TO. . . 

COLLECT  THE  ANSWERS 


Personal  Interviewing 

Gettin|g  Set 

The  ideal  to  aim  for  in  interviewing  is  to  carry  out  all  interviews 
exactly  the  same  way  so  that  the  people  being  interviewed: 

•  All  have  an  equal  chance  to  answer  the  same  questions 

•  All    are    given    the    same    answers     to  questions  they  ask  about  the 
survey 

•  All  are  interviewed  in  the  same  manner 
Approaching  the  Person  to  be  Interviewed 

Each  interviewer  is  provided  either  with  a  list  of  addresses  or  given  more 
general  instructions  such  as:  carry  out  an  interview  at  every  second 
house . 

The  interviewer  needs  to  know  if  there  are  any  restrictions  on  the  person 
that  is  to  be  interviewed  at  each  house.  For  example,  eligible  people 
might  be: 

•  Anyone  over  18 

•  Anyone  who  lives  in  the  house  (not  a  visitor) 

•  Anyone  who  is  a  parent 

If  no  eligible  interviewees  are  at  home,  the  interviewer  records  the  time 
of  the  attempted  interview  and  returns  at  a  different  time  of  day  to 
complete  the  interview.  Usually,  about  three  attempts  are  made  to 
complete  an  interview.  Rather  than  dropping  in,  the  interviewer  could 
pre-arrange  an  interview  time  and  schedule  the  interviews.  This  may  take  a 
little  longer  to  set  up  but  would  be  a  more  effective  use  of  interviewer 
time . 

If  the  interviewee  is  at  home,  the  interviewers  would  go  through  a  process 
which  would  include : 

•  Introducing  themselves 

•  Explaining  the  reason  for  the  visit 

•  Providing  background  information  on  the  survey  and  the  sponsors 

•  Explaining    the     length  of  time  required  for  the  interview  itself  to 
ensure  there  is  no  misunderstanding 

Name  tags  with  picture  identification  may  prove  useful  for  the 
interviewers.  These  can  be  obtained  through  a  vehicle  licensing  branch, 
which  may  be  able  to  laminate  them  as  well.  A  contact  number  should  be 
readily  available  should  an  interviewee  want  to  verify.  The 
delivery/interview  schedules  should  be  kept  track  of  and  be  provided  to  a 
survey  coordinator. 
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Carrying  out  the  Interview 

Since  the  point  of  a  survey  is  to  learn  what  the  person  being  interviewed 
has  to  say,   it  is  important  for  all  interviewers  to: 

•  Avoid  suggesting  answers 

•  Avoid  giving  opinions 

•  Avoid  showing  any  reaction  to  answers 

Interviewing  is  demanding  work.  The  interviewer  needs  to  listen  closely 
to  every  word  that  is  said  and  either  check  off  the  closest  answer 
provided  on  the  survey  form  or  write  down  the  person's  answer  where  the 
question  is  open-ended.  The  interviewer  also  needs  to  keep  up  the  pace  of 
the  interview  so  that  the  person  being  interviewed  does  not  lose  interest. 

Keeping  Notes  Up-to-Date 

Interviewers  need  time  at  the  end  of  each  interview,  or  each  day  of 
interviewing,  to  review  the  interviews.  Sometimes  handwriting  needs  to  be 
clarified  or  short  forms  written  out  in  full  so  that  the  person  who 
analyzes  the  interviews  can  understand  what  was  said. 

Respecting  Privacy 

Interviewers  must  agree  to  keep  the  confidence  of  all  the  people  they 
interview.  Comments  about  such  things  as  the  conditions  of  the  house  or 
the  treatment  of  children  are  not  acceptable  and  could  reflect  badly  on 
the  sponsors  of  the  survey.  Also,  in  the  future  people  may  decline  to 
participate  in  a  survey  to  protect  their  privacy. 

It  is  very  tempting  to  tell  friends  over  coffee  some  of  the  things  people 
say  during  interviews.  The  only  place  where  these  stories  belong  is  at  the 
debriefing  sessions  held  by  the  survey  coordinator.  Interviewers  can  share 
their  experiences  at  these  sessions  and  the  coordinator  can  work  out 
standard  ways  of  handling  any  interview  problems  that  are  reported  more 
than  once , 
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HOW  TO. . . 

COLLECT  THE  ANSWERS 

Telephone  Interviewing 

Most  of  the  section  on  personal  interviewing  applies  to  telephone 
interviewing  as  well ,  although  there  are  a  few  differences .  Telephone 
interviewers  are  provided  either  with  a  list  of  names  and  phone  numbers  or 
are  assigned  specific  pages  of  the  phone  book  and  asked  to  call  every 
fifth  private  number,  for  example. 

Telephone  interviewing  is  often  done  from  private  homes.  In  these  cases, 
interviewers  need  to  plan  for  uninterrupted  interviewing  time  and  ample 
work  space  for  separating  and  stacking: 

•  Completed  surveys 

•  Numbers  to  be  called  again  at  a  specific  time 

•  Numbers  to  be  tried  again  where  there  has  been  no  answer  so  far 

•  Refused  interviews 

•  Blank  surveys 

•  List  of  names  to  be  called 

Telephone  interviewers  quickly  learn  by  trial  and  error  what  time  of  day 
the  group  of  people  they  need  to  interview  is  near  the  telephone. 
Interviewers  are  advised  to  avoid  leaving  a  message  for  people  to  call 
back;  people  calling  back  will  be  unable  to  reach  the  interviewer  if  an 
interview  is  underway  and  it  is  often  a  waste  of  interview  time  to  not  use 
the  phone  while  waiting  for  a  call -back. 

Mail  Questionnaires 

Arrange  for  the  mail -out  of  all  surveys  to  allow  about  five  business  days 
for  people  to  complete.  Ensure  a  date  for  returning  the  questionnaire  is 
provided. 

It  is  most  efficient  to  keep  all  returned  survey  envelopes  unopened  in  a 
box  and  then  open  and  check  off  the  returns  against  the  mailing  list  all 
at  one  time . 

Keep  track  of  the  number  of  returned  surveys  received  each  day.  That  way 
you  can  see  the  pattern  of  returns  and  can  stop  waiting  for  further 
returns  when  there  have  been  only  one  or  two  a  day  for  a  week. 
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Group  Discussions 

As  was  mentioned  in  the  handbook,  there  are  two  group  discussion  methods: 

•  Focus  groups 

•  Public  meetings 

To  re -cap  from  the  handbook,  a  public  meeting  is  an  open  meeting  where 
anyone  interested  in  the  topic  can  attend  and  share  his  or  her  views.  A 
focus  group  is  a  more  systematic  process.  People  with  specific  backgrounds 
are  invited  to  attend  and  a  focus -group  facilitator  leads  the  group 
through  a  specific  process. 

Focus  Groups 

In  a  focus  group,  six  to  12  people  are  invited  to  attend^.  The  group 
would  all  meet  around  a  table  in  a  room  free  of  distractions .  Each  person 
should  be  provided  with  paper  and  pencil.  The  room  should  be  well-equipped 
with  at  least  one  flipchart,  and  a  chalkboard  or  whiteboard. 

The  group  facilitator  leads  the  process.  The  facilitator  need  not  be  the 
official  leader  of  the  group,  for  example,  the  chairperson  of  the 
sponsoring  organization.  Rather,  the  facilitator  should  be  selected  on  the 
basis  of  leadership  skills,  communication  and  interpersonal  skills  and 
discussion  group  skills.  Anyone  with  these  strengths  from  within  the 
community  would  be  a  good  choice.  It  is  important  that  this  person  be  seen 
as  having  no  bias  toward  any  side  of  the  issue  being  discussed. 

It  is  a  good  idea  to  also  have  an  official  recorder  who  can  write  down  the 
ideas  that  are  discussed  on  a  flipchart  or  blackboard.  This  person  should 
also  be  neutral,  have  legible  handwriting,  and  be  able  to  summarize  points 
and  pick  out  key  ideas. 

The  "focus"  of  the  groups'  discussion  is  a  clearly  worded  question  or 
problem  which  has  been  previously  decided  on.  This  statement  or  question 
could  either  be  written  on  a  handout  and  distributed  to  group  members 
and/or  it  could  be  written  on  the  chalkboard  or  flipchart.  An  example  of  a 
focus  group  question,  to  use  the  situation  in  the  handbook  of  Joy's 
Recreation  Board  in  Northview,  could  be: 

What  information  does  the  recreation  board  need  about  the  recreation 
services,  the  conimunity  and  the  people  who  live  here,  to  make  an 
informed  decision  about  enhancing  recreation  services? 
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The  group  leader  starts  the  process  by: 

•  Introducing  himself/herself 

•  Providing  background  information  on  the  survey  and  the  sponsors 

•  Explaining  how  the  participants  were  selected 

•  Leading  introductions 

•  Providing  information  on  what  will  be  taking  place  in  the  meeting 

•  Answering  any  questions 

Once  everyone  is  comfortable  with  the  process ,  the  focus  group  begins . 

There  are  different  approaches  that  can  be  used  to  lead  the  discussion. 
Possibilities  include: 

•  Asking  each  person  to  write  their  own  answers  to  the  question  and 
then  compare  answers 

•  Brainstorming  as  a  group  possible  answers  to  the  question 

•  Dividing  the  group  into  two  and  asking  each  half  to  develop  points 
either  for  or  against  the  issue  and  then  compare  notes 

In  the  document  Needs  Assessment  Handbook:  A  Close -Up  Look,  developed  by 
the  Library  Services  Branch  of  Alberta  Culture,  a  detailed  step -by- step 
process  is  outlined  using  the  first  approach,  whereby  the  group  writes 
down  their  answers  individually  and  then  compares.  That  process  is 
outlined  below^.  It  will  serve  as  a  guide,  and  can  be  adapted  to  other 
approaches . 

The  process  begins  with  the  group  leader  explaining  what  will  happen 
during  the  meeting,  stating  the  question  and  giving  the  necessary 
instructions.  Each  person  is  asked  to  write  down  on  paper  all  of  the 
answers  to  the  stated  question.  At  this  time,  there  is  no  discussion 
within  the  group;  the  emphasis  is  on  individual  concentration. 

Following  this  step: 

•  The  leader  asks  each  person  in  turn  to  contribute,  without 
discussion,  one  idea  from  his  or  her  list  of  answers 

•  The  recorder  writes  each  idea  on  the  chalkboard  or  easel  clearly 
and  concisely,  using  the  contributor's  own  words  wherever  possible 

•  When  each  group  member  has  contributed  one  idea,  the  process 
continues  until  every  item  on  each  list  has  been  mentioned  and 
recorded  in  front  of  the  group 

•  No  discussion  or  evaluation  of  the  suggestions  takes  place  until 
all  of  the  ideas  are  written  down  by  the  recorder 
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The  group  now  has  a  large  list  of  ideas  which  have  been  given  as  possible 
answers  to  the  stated  question.  Discussion  begins  as  each  idea  is 
examined  in  a  systematic  order.  Participants  may  ask  for  clarification  of 
the  ideas,  and  points  for  and  against  any  given  idea  may  emerge.  This 
will  help  the  group  members  to  make  any  decisions  that  are  required.  When 
each  idea  has  received  careful  attention  and  seems  to  be  clearly 
understood  by  all  group  members,  voting  takes  place. 

There  are  a  number  of  ways  to  vote  on  a  decision  or  gain  concensus  on  an 
issue.  One  quick  and  easy  way  is  to  get  a  show  of  hands.  However,  if  there 
are  concerns  over  anonymity  or  a  long  list  of  ideas,  a  rating  system  may 
be  more  effective. 

•  Ranking  -  For  a  small  number  of  items  (ten  or  less)  group  members 
can  individually  rank  each  item,  marking  down  the  most  important 
item  as  #1,  the  next  important  as  #2,  and  so  on.  Thus,  if  there  are 
seven  items,  they  would  be  ranked  "one"  through  "seven".  This 
process  requires  the  participants  not  only  to  rate  an  item  but  to 
rank  it  in  relation  to  the  other  items. 

•  Rating  -  Another  method  for  coming  to  a  concensus  is  to  look  at 
each  item  individually  and  rate  it  as  a  high  priority  or  a  low 
priority.  Numerical  values  could  be  assigned.  For  example  a  rating 
of  "five"  is  a  high  priority  and  a  rating  of  "one"  is  a  low 
priority,  with  various  ratings  in  between. 

Following  the  rating  by  each  member,  the  results  are  then  tallied.  For 
each  item  or  issue,  the  numerical  values  would  be  added  up.  The  resulting 
total  for  each  item  would  indicate  what  the  group  feels  as  a  whole.  The 
list  can  then  be  used  as  part  of  the  decision-making  process  because  it  is 
now  clear  what  information  the  focus  group  feels  is  most  important. 

This  process  uses  a  group  of  people  working  together  and  exchanging  ideas 
and  information  to  work  on  a  problem.  When  it  is  used  with  people  from  the 
community,  it  provides  the  added  benefit  of  increasing  public  awareness  of 
the  concern  or  issue. 

Since  focus  group  discussions  can  vary  from  those  with  a  very  set 
procedure  to  those  which  are  quite  free-wheeling,  the  types  of  answers 
resulting  from  the  discussion  will  vary. 

The  answers  or  suggestions  from  a  more  free-wheeling  focus  group  may  be  in 
the  form  of  a  list  or  a  list  divided  into  top,  middle  and  lowest 
priorities.  In  such  cases,  the  ideas  on  the  list  are  examined  further  but 
the  ideas  are  not  summed  up  in  any  way. 

Sometimes  the  points  brought  up  in  a  focus  group  discussion  are  used  to 
help  decide  some  of  the  questions  to  include  in  a  personal,  telephone  or 
mail  survey.  Comments  made  during  focus  group  discussions  may  also  help 
with  the  wording  of  survey  questions. 

The  following  flow  chart  summarizes  the  process  involved  in  carrying  out  a 
focus  group  discussion. 


FOCUS  GROUP  DISCUSSION 
FLOW  CHART 


On  the  basis  of  information  needed, 
the  working  conunittee  decides  on  a 
discussion  question  and  which  group (s) 
of  people  will  be  represented  in  the 
discussion. 


The  working  committee  asks  people  to 
participate  in  the  meeting,  sets  the 
time  and  place,  and  appoints  a  leader 
and  a  recorder  informed  about  the 
process . 


The  leader  explains  the  process  at 
the  start  of  the  meeting.  Participants 
are  asked  to  individually  list  answers 
to  the  discussion  question. 


Each  person  in  turn  gives  one  item 
from  the  list.  The  process  continues 
until  all  items  on  every  person's  list 
are  recorded  on  a  flipchart  or  black- 
board. 


The  group  examines  each  idea  on  the 
recorder's  list,  stating  opinions, 
asking  for  clarification  and  discuss- 
ing the  items . 


The  group  members  vote  privately  on 
each  item  on  the  recorder's  list, 
using  an  agreed-upon  rating  system. 

The  results  are  tallied. 

The  list  of  the  group's  priorities  are 
prepared  from  the  vote  results . 
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Public  Meetings 

The  most  direct  form  of  community  participation  occurs  though  public 
meetings.  Public  meetings  can  sometimes  be  frustrating  situations,  but 
with  thought  and  preparation  that  can  be  avoided.  There  is  a  tendency  for 
special  interest  groups  to  be  over -represented  at  public  meetings  and 
other  groups,  such  as  seniors  and  teens,  under- represented.  It  is 
important  to  obtain  a  good  cross -section  of  the  population  and  efforts 
should  be  directed  in  this  area. 

The  following  guidelines  for  holding  a  public  meeting  are  taken  from  the 
report  Community  Recreational  Needs  Study  Manual.^ 


Prepare  Background  Information 

•  Define  the  purpose  and  objectives  of  the  meeting 

•  Identify    who    should  be  invited  to  the  meeting,  both  supporters  and 
critics,  and  encourage  their  involvement 

•  Ensure    people     are     aware    of    and  understand  the  issues  before  the 
meeting 


Choose  a  Location 


•  Select  a  location  keeping  a  number  of  considerations  in  mind: 

-  Proximity 

-  Parking 

-  Visibility 

-  Suitability 

•  Book  the  facility 


Inform  the  Public 


•  Undertake  a  publicity  campaign  one  month  before  the  meeting 

•  Use  a  variety  of  mediums 

-  Newspaper      -     paid    advertising,     editorials,     community  service 
announcements 

-  Television  -  local  cable  TV  channel  announcements 

-  Radio     -     news     releases,     public    service  announcements,  phone-in 
radio  shows 

-  Posters,  fliers,  newsletters 

-  Telephone  or  door -to -door  campaigns 

-  Buttons,  bumper  stickers,  T-shirts 

•  Contact  key  community  groups  or  leaders ,   such  as  churches  or  PTAs 

•  Communicate    date,     time,  location,  reason  for  meeting  and  a  contact 
number 
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Select  a  Chairperson 

•  Ensure  the  individual  is  skilled  and  unbiased  or  neutral 

•  The  chairperson  should  allow  everyone  to  speak  yet  limit 
overbearing  and  opinionated  individuals  from  controlling  the 
meeting 


Develop  an  Agenda 

•  Ensure  the  agenda  is  well  organized  and  specific 

•  Schedule  time  for  speakers  and  be  prepared  to  enforce  it 

•  Arrange  for  a  secretary  or  recorder 

•  Encourage  participants  by  scheduling  small  group  discussions 


Arrange  Equipment  and  Supplies 

•  Check    equipment    that     is     available    and    arrange     for  additional 
equipment 

•  Test  equipment  before  the  meeting 

•  Arrange  public  address  system,   tables,  chairs,   f lipcharts ,  etc. 

•  Put  up  signs  to  direct  the  participants 

•  Arrange  for  refreshments 


Follow  Up 

•  Provide    feedback    to    the    public  on  the  results  of  the  meeting  and 
the  importance  of  their  contribution 

•  Write  a  short  report  on  the  meeting,  noting: 

-  Why  the  meeting  took  place 

-  The  objectives 

-  Attendance 

-  Outcome 

-  Actions 
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HOW  TO. , . 

ANALYZE  THE  ANSWERS 

Rate  of  Response 

The  first  thing  that  needs  to  be  done  when  you  have  completed  collecting 
answers  to  your  survey  is  to  calculate  the  "rate  of  response" .  The  "rate 
of  response"  is  the  percentage  of  people  who  answered  your  survey. 

Calculate  the  rate  of  response  as  follows: 

number  who  answered  the  survey 

 X  100  =  percent  or  rate 

of  response 

number  asked  to  answer  the  survey 

For  example  if  83  people  answered  out  of  95,  the  rate  response  would 
be:  83  X  100  -  87% 

95 

On    the  other  hand,   if  83  answered  out  of  212,   the  rate  of  response  is  much 
lower:   83  x  100  =  39% 
212 

The  higher  the  rate  of  response,  the  more  reason  you  have  to  assume  that 
the  answers  you  collected  apply  to  everybody  you  surveyed, 

A  low  rate  of  response  is  around  20  percent. 

A  high  rate  of  response  is  around  80  percent. 

Different  types  of  survey  methods  tend  to  yield  different  rates  of 
response.  For  a  telephone  survey,  a  60%  rate  of  response  is  an  average 
rate.  A  rate  of  response  of  70%  is  considered  good;  less  than  50%  is  cause 
for  concern.  A  drop  off /pickup  survey,  on  the  other  hand,  has  a  40% 
average  rate  of  response;  less  than  30%  is  cause  for  concern. 

If  the  rate  of  response  for  your  survey  was  low  (usually  a  problem  with 
mail  questionnaires) ,  try  a  telephone  follow-up  to  some  who  did  not  answer 
to  collect  the  opinions  of  more  people.  With  a  low  rate  of  response,  your 
committee  will  have  to  decide  whether  to  re -survey  or  whether  to  start 
again.  If  you  decide  to  go  ahead  with  your  results,  interpret  your  answers 
cautiously  and  don't  generalize  to  the  entire  population.  You  will  also 
want  to  evaluate  what  went  wrong. 
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Sorting 

This  is  the  point  where  the  survey  process  can  begin  to  become  bogged 
down.  On  the  surface  it  looks  easy  to  just  count  up  what  people  said. 
But  is  it  just  straightforward  counting?    And  what  do  the  numbers  mean? 

This  section  has  some  jargon  words  in  it  -  but  they  have  been  kept  to  a 
minimum  and  are  explained  as  they  come  up. 

"Sorting"  is  the  process  where  you  count  up  how  many  people  gave  each  of 
the  possible  answers  to  your  survey  questions. 

There  are  basically  three  ways  to  sort  answers.  The  first  two  methods 
will  be  discussed  here:  ^ 

•  Hand  sorting 

•  Hand  counting  from  code  sheets 

•  Computers 

Computers  are  useful  when  someone  is  available  to  carry  out  computer 
analysis  of  the  answers.  Commercial  programs  such  as  Lotus  1-2-3  are 
suitable,  but  training  someone  to  learn  to  use  the  program  could  slow  down 
your  project.  If  you  select  the  computer  method,  you  will  need  to  rely  on 
expert  advice. 


Hand  Sorting  for  Closed  Questions 

In  hand  sorting,  the  answers  to  each  question  are  totalled  up  one  question 
at  a  time.  There  are  two  different  sorting  procedures.  One  kind  is  used 
for  questions  where  the  person  can  only  give  one  answer:  the  second  kind 
is  used  for  questions  where  the  person  can  give  more  than  one  answer. 

Sorting  When  Only  One  Answer  is  Given 

Let's  work  through  an  example  of  a  question  with  three  possible  answers 
and  each  person  can  give  only  one  of  the  answers . 

EXAMPLE:     Are    you    interested    in    sending    your  children  to  Northview 
day- camp  this  summer? 

^  Interested 

□ 


□ 


Not  sure 
Not  interested 
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Step  1:  Separate  the  surveys  into  three  piles  according  to  the 
answer  given: 

Interested  Not  Sure  Not  Interested 

Step  2:  Count  the  number  of  surveys  in  each  pile  and  record  the 
totals  on  a  clean  survey  that  will  be  used  as  a  tally  of  all 
the  results.  The  total  of  all  three  piles  should  equal  the 
total  number  of  people  who  answered  the  survey.  Double 
check  the  count  of  each  pile  if  the  total  is  incorrect. 
Your  tally  could  look  like  this: 

47  interested 
11      not  sure 
4      not  interested        (total  =  62) 


Step  3:  Repeat  Steps  1  and  2  for  each  question  in  the  survey  where 
all  possible  answers  are  provided  and  each  person  can  give 
only  one  answer  to  the  question. 


Sorting  When  More  Than  One  Answer  Can  Be  Given 

Here's  an  example  of  a  question  with  five  possible  answers  and  each  person 
can  give  more  than  one  answer  to  the  question. 

EXAMPLE:     Which    of    the     following  activities  would  your  children  aged 
six  to  eight  likely  be  interested  in  at  day-camp? 
(Check  all  that  apply.) 

n 


□ 
□ 
□ 
□ 


Swimming 
Track  and  field 
Life  in  an  early  settler  camp 
Building  a  nature  exhibit  for  the  fair 
Drawing  and  painting 


Step  1:       Separate     the  surveys  into  two  piles,   according  to  whether  or 
not  the  person  chose  the  first  answer. 

Swimming  Not  Swimming 
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Step  2:  Count  the  number  of  surveys  in  each  pile.  The  total  should 
equal  the  total  number  of  people  who  answered  the  survey. 
Double  check  the  count  of  each  pile  if  the  total  is 
incorrect.  Enter  the  number  who  chose  the  first  answer  on 
the  tally  sheet,  as  below: 

17  swimming 

  track  and  field 

  life  in  an  early  settler  camp 

  building  a  nature  exhibit  for  the  fair 

_____  drawing  and  painting 


Step  3:  Repeat  Steps  1  and  2  for  each  of  the  possible  answers  to  the 
question. 

Step  4:  Repeat  Steps  1,  2  and  3  for  each  question  in  the  survey 
where  each  person  can  give  more  than  one  answer  to  the 
question. 

Hand  Sorting  for  Open- Ended  Questions 

Open-ended  questions  in  a  survey  are  more  difficult  to  sort  than  closed 
questions . 


For  each  open-ended  question,  read  over  all  of  the  answers  that  have  been 
given.  Group  the  answers  into  piles,  placing  similar  answers  together. 
Then  write  a  short  phrase  that  most  closely  fits  the  answers  in  each  pile. 

There  are  usually  a  number  of  cases  where  only  one  person  gives  that 
particular  answer.  All  these  one-of-a-kind  answers  are  usually  grouped 
under  a  category  labelled  "Other" . 

EXAMPLE:     What      would      be      your      main      reason    for    enroling  your 
elementary- aged  children  in  summer  day- camp? 

After  a  review  of  all  the  answers ,  the  following  categories  can  be 
developed: 


•  Summer  day- camp  is  fun 

•  Summer    day- camp    provides    more  interesting  experiences  for  my  kids 
than  I  can  on  my  own 

•  I    work    and    would  leave  my  kids  with  a  babysitter  if  there  were  no 
camp 

•  Other 


The  number  of  people  giving  an  answer  in  each  of  the  above  categories  is 
then  counted  and  recorded,  using  the  "Sorting  When  More  Than  One  Answer 
Can  Be  Given" . 
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Coding 


Setting  up  a  Code  Book  and  Code  Sheet 

If  you  have  more  than  30  questionnaires,  each  with  at  least  seven 
questions,  you'll  need  to  make  summaries  of  the  answers  to  each  question. 
A  code  book  will  allow  you  to  record  all  the  information  on  one,  or  a  few, 
pages . 

Step  1:  The  first  step  in  developing  a  code  book  is  to  go  back  to  your 
pile  of  questionnaires  and  give  each  one  a  code  number.  This 
will  be  the  respondent's  identifying  number  and  a  substitute  for 
his  or  her  name.  Using  the  number  will  ensure  that  a  person's 
questionnaire  is  not  recorded  twice  by  mistake,  and  will  allow 
you  to  check  back  for  errors . 

On  the  next  page,  the  sample  code  sheet  uses  columns  1  and  2  for 
the  respondents'  identifying  numbers.  The  two  columns  are 
necessary  because,  with  thirty  respondents,  we  must  enter 
double-digit  numbers.  More  than  99  questionnaires  would  require 
three  columns  for  respondents'  numbers  (e.g.,  001-099,  100,  101, 
etc. ) . 

Step  2:  Assign  each  question  a  column  number:  Question  #1  (sex)  in  column 
3,  Question  #2  (age)  in  column  4,  and  so  on. 

Step  3:  Give  each  answer  category  of  each  question  a  code  number.  In  our 
example.  Question  #1  Male  is  given  a  code  of  0  and  Female  is 
given  a  code  of  1.  They  could  easily  have  been  coded  Male  1, 
Female  2.  Some  researchers  avoid  codes  of  0  because  the  zero  may 
mislead  people  into  thinking  there  was  no  response. 

Because  each  question  is  assigned  a  different  column,  you  can  use 
the  same  code  numbers  over  again  for  the  response  categories  in 
each  question,  as  has  been  done  in  our  example  on  the  next  pages. 
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Sample  Questionnaire 

1.  What  is  your  sex?    MALE  _JL  FEMALE 

2 .  Please  check  the  category  that  includes  your  age . 


X      under  20  YEARS 

  20  -  34  YEARS 

  35  -  49  YEARS 

  50  -  64  YEARS 

65  PLUS 


3.     Please    check    the    category    below    that    includes  the  furthest  formal 
education  you  have  completed. 

X      LESS  THAN  GRADE  9 

  9  -  11  AND  NO  OTHER 

  9  -  12 

  9  -  12  AND  SOME  OTHER 

  UNIVERSITY 


4.  Please    check    off    the    one    category    that    includes  the  total  actual 
income  in  your  household. 

  LESS  THAN  $3,000 

  $3,000  -  $5,999 

  $6,000  -  $8,999 

X      $9,000  -  $11,999 

  $12,000  -  $14,999 

  $15,000  -  $17,999 

  $18,000  -  $20,999 

  $21,000  AND  OVER 

5.  How  would  you  describe  your  current  physical  activity  level? 

  CONSIDERABLY  BELOW  AVERAGE 

  SOMEWHAT  BELOW  AVERAGE 

X  AVERAGE 

  SOMEWHAT  ABOVE  AVERAGE 

  CONSIDERABLY  ABOVE  AVERAGE 


Between  May  1989  and  May  1990,  how  many  different  sports  did  you 
engage  in? 

7  SPORTS 


6. 

engage 


7 .  Are  you  personally  involved  in  playing  sof tball? 

  YES  X  NO 

8 .  How    much    are    you    willing  to  spend  per  season  to  support  sof tball  in 
the  community? 

X      LESS  THAN  $1.00 

  $1.00  -  $1.49 

  $1.50  -  $1.99 

  $2.00  OR  MORE 
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Assigning  Codes  to  Sample  Questionnaire 
Question  Column  Codes 


1,2  Respondent  Number  (0 
3  Sex 


31) 


0  Male 

1  Female 


Age 


1 

12- 

19 

years 

2 

20' 

■34 

years 

3 

35- 

■49 

years 

4 

50- 

■64 

years 

5 

65 

+ 

Educational  Level 

1  Less  than  Grade  9 

2  9-11  No  other 

3  9-12 

4  9-12  Some  other 

5  University 


Household  Income  (annual) 
1    Less  than  $3,000 
$3,000  -  $5,999 
$6,000  -  $8,999 
$9,000  -  $11,999 
$12,000  -  $14,999 
$15,000  -  $17,999 
$18,000  -  $20,999 


Respondent  Number  One 

0 


1 

2 

3 

4 

5 

6 

7 

8 

9 

0 

1 

$21,000  and  over 


8.9 


10 


Activity  Level 

1  Considerably  below  average 

2  Somewhat  below  average 

3  Average 

4  Somewhat  above  average 

5  Considerably  above  average 

Number  of  sports  engaged  in  during 
previous  year  (00-99) 

Personally  interested  in  playing  softball? 

1  Yes 

2  No 


11  How  much  would  you  spend  on  softball  fees? 

1  Less  than  $1.00 

2  Between  $1.00  and  $1.49 

3  Between  $1.50  and  $1.99 

4  $2.00  or  more 
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Coding  Sheet 

A  coding  sheet  for  the  sample  questionnaire  is  shown  below.  Twenty -one  of 
the  thirty  respondents  are  listed.  Just  for  practice,  you  may  want  to  look 
at  the  sample  questionnaire  on  page  50  and  transfer  the  responses  into  the 
coding  sheet.  The  identifying  number  is  01.  The  correct  codes  are  noted 
below.* 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

0 

1 

0 

2 

1 

1 

1 

3 

3 

0 

0 

2 

3 

0 

3 

0 

2 

3 

4 

4 

0 

6 

1 

2 

0 

4 

1 

3 

3 

5 

4 

0 

4 

1 

3 

0 

5 

1 

4 

4 

3 

5 

0 

9 

2 

2 

0 

6 

1 

3 

3 

5 

5 

0 

2 

2 

1 

0 

7 

0 

3 

3 

5 

5 

0 

7 

1 

4 

0 

8 

0 

2 

2 

4 

2 

0 

5 

1 

3 

0 

9 

0 

2 

2 

3 

3 

1 

1 

1 

2 

1 

0 

0 

2 

2 

3 

4 

1 

2 

1 

3 

1 

1 

0 

1 

1 

2 

2 

1 

1 

1 

4 

1 

2 

1 

2 

2 

3 

4 

0 

5 

1 

3 

1 

3 

1 

2 

2 

4 

3 

0 

6 

1 

3 

1 

4 

0 

5 

4 

7 

5 

0 

5 

2 

3 

1 

5 

1 

1 

1 

1 

3 

0 

0 

2 

4 

1 

6 

0 

2 

1 

3 

1 

1 

2 

1 

2 

1 

7 

1 

3 

3 

5 

4 

0 

3 

2 

4 

1 

8 

1 

4 

4 

7 

5 

1 

0 

2 

3 

1 

9 

1 

2 

2 

4 

3 

0 

7 

1 

3 

2 

0 

1 

2 

2 

4 

2 

0 

2 

1 

2 

2 

1 

3 

3 

5 

4 

0 

8 

1 

4 

*  The  sample  questionnaire 
codes  starting  at  column 
3  should  be:  1.  1.  1.  1. 
4.  3.  0.  7.  2.  1. 
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Cross -sorting 

Cross -sorting  allows  you  to  compare  the  way  people  answer  one  question  to 
the  way  they  answer  another  question. 

Background  questions  are  usually  cross -sorted  with  one  or  more  survey 
questions  to  help  explain  answers  to  questions  in  the  survey. 

Cross -Sorting  When  Only  One  Answer  Is  Given  to  the  Second  Question 

EXAMPLE:     Compare  answers  to  background  Question  #17: 

Do  you  live 
_______  in  town 

_______  on  the  town  outskirts 

________  within  10  km  of  town 

_______  further  than  10  km  from  town 


with  answers  to  Question  #13: 

Do  you  have  space  for  a  summer 
camp  activity  on  your  property? 

^  No 
__  Yes 

If  yes,  list:   


(activity) 

Step  1:       Separate    surveys    according    to    answers  on  Question  17  into 
four  piles. 


In  Town 
total  =  14 


Step  2:       Separate  each  pile  from  question  17  into  two  piles  according 
to  the  answer  to  Question  13.    I  I 


Space      No        Space      No  Space      No  Space  No 

Space  Space  Space  Space 


total 

total 

total 

total 

total 

total 

total  total 

=  1 

=  13 

=  2 

-  10 

=  9 

=  6 

=  8  =2 

Outskirts 
total  =  12 


Within  5  km 
total  =  15 


Further  than  5  km 
total  =  10 
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Step  3:      Record  the  numbers  from  each  of  the  piles  in  a  table. 


A  Comparison  of  Where  People  Live 
and 

Available  Space  for  Camp  Activities 

Space  for 
Camp 

Activity  Residence 

Within  Further 
In  Town      Outskirts        10  km        than  10  km 


YES  1  2  9  8 

NO  13  10  6  2 


From  this  table  you  can  see  that  people  living  further  from  town  have 
more  space  for  camp  activities,  which  is  what  you  would  probably 
expect.  But  you  also  found  three  places  in  town  or  on  the  outskirts 
with  space  that  you  did  not  expect. 

The  fill-in  answers  for  the  kinds  of  activity  that  people  have  space 
for  can  now  be  recorded  from  each  pile.  Make  a  handwritten  list, 
keeping  clear  the  place  of  residence  with  the  types  of  activity 
offered. 


Space  for  Activities 
In  Town  Outskirts  Within  10  km  Further  than  10  km 


swimming  pool      picnics  picnics  picnics 

volleyball        campfire  fishing 

badminton         hiking  in  woods  hiking  in  woods 

field  sports  field  sports 
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Cross -Sorting  When  More  Than  One  Answer 
Can  Be  Given  to  the  Second  Question 


EXAMPLE:     Compare  answers  to  background  Question  17: 


Do  you  live 

  in  town 

  on  town  outskirts 

.  .  within  10  km  of  town 

______  further  than  10  km  from  town 


with  answers  to  Question  8: 


Which  sites  would  you  be  willing 
to  drive  your  children  to  for 
day- camp? 

Cook's  Corners?  Yes   ^  No 

The  ball  park?  Yes   .  No 

First  Church?        _„  Yes   No 


Step  1:  Separate  the  surveys  according  to  answers  on  Question  17 
into  four  piles. 

Step  2:  For  each  of  those  piles  count  the  number  given  each  of  the 
answers  to  Question  8  using  the  method  explained  on  page 
53 o  Since  people  can  give  any  or  all  answers  to  Question  8, 
each  choice  is  counted  separately.  The  diagram  shows  the 
total  of  "Yes"  answers  after  cross -sorting  has  been 
completed. 


In  Town 
total=14 


CC  BP  FC 
9  14  14 


Outskirts 
total=12 


Within  10  km 
total=15 


Further  than  10km 
total=10 


I     I  ! 

CC  BP  FC 

10  11  12 


CC  BP  FC 
15  11  11 


CC  BP  FC 
10    7  6 


Key:     CC  -  Cook's  Corners 
BP  -  Ball  Park 
FC  -  First  Church 


Step  3: 


Record  the  number  of  "Yes"  answers  for  each  of  the 
combinations  in  a  table. 
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A  Compari 

son  of  Where  People 

Live 

and 

The  Camp  Location 

They  Are  Willing 

to  Drive 

To 

Camp  Locations 

Residence 

Within 

Further 

In  Town 

Outskirts 

10  km 

than  10  km 

Total 

Cook's  Corners 

9 

10 

15 

10 

44 

Ball  Park 

14 

11 

11 

7 

43 

First  Church 

14 

12 

11 

6 

43 

This  table  shows  how  background  information  can  explain  people's 
answers.  Looking  at  the  Camp  Location  totals,  the  three  choices  are 
almost  equal  (44,  43,  43). 

But  looking  at  the  circled  numbers  and  see  the  most  popular  choices  of 
people  according  to  their  place  of  residence. 

These  differences  could  be  taken  into  account  in  reaching  a  final 
decision  on  a  campsite. 


Comparing:  Answers  from  Different  Groups  to  the  Same  Question 

One  of  the  reasons  for  surveying  more  than  one  group  is  to  collect 
different  points  of  view  on  the  same  issue.  If  you  have  asked  the  same 
question  of  more  than  one  group,  you  can  bring  those  answer  totals 
together  in  one  table  to  compare  them  as  in  the  following  example. 


Opinions  on  Whether  the  Swimming  Pool 
Should  be  Open  in  June 

Survey  Group  Yes        No        No  Opinion  Total 

Season's  Pass  Holders  149  7  0  156 

Local  Taxpayers  130        193  47  370 


From  the  above  table  you  can  see  a  large  majority  (149  out  of  156  or 
95.5%)  of  season's  pass  holders  want  the  pool  open  in  June  compared  to 
about  one-third  (130  out  of  370  or  35.1%)  of  taxpayers. 
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Appendix  A 


Resource  Agencies 


Alberta  Biireau  of  Statistics 


7th  Floor,  9811  -  109th  St. 
Edmonton,  Alberta 
T5K  0C8 


427-3058 


Alberta  Career  Development  and  Employment 

Regional  Offices 


CityCentre,  10155  -  102th  St. 
Edmonton,  Alberta 
T5J  4L5 


422-0046 


Bag  900-41 
9621  -  96th  Ave. 
Peace  River,  Alberta 
T8S  1T4 


624-6531 


Alberta  Culture  and  Multicultural ism 

Regional  Cultural  Consultants 

#2501  Provincial  Building 
10320  -  99th  St. 
Grande  Prairie,  Alberta 

T8V  6J4  538-5408 

#316  Provincial  Building 
5025  -  49th  Ave. 
St.  Paul,  Alberta 

TOA  3A0  645-6328 


Alberta  Economic  Development  and  Trade 

Regional  Business  Development  Branch 
Regional  Offices 

Box  2490 

111  -  54th  St. 

Edson,  Alberta 

TOE  3A0  738-8229 

Bag  900-3 

10122  -  100th  St. 

Peace  River,  Alberta 

T8S  1T4  624-6113 


Alberta  Economic  Development  and  Trade  (cont.) 


#1401  Provincial  Building 
10320  -  99th  St. 
Grande  Prairie,  Alberta 

T8V  6J4  538-5230 


Box  1688 

5025  -  49th  Ave. 

St.   Paul,  Alberta 

TOA  3A0  645-6358 


Alberta  Municipal  Affairs 
Px.egional  Office 

Bag  900-30 

9621  -  96th  Ave. 

Peace  River,  Alberta 

T8S  1T4  624-6189 


Planning  Services  Division 
12th  Fir.,  CityCentre 
10155  -  102  St. 
Edmonton,  Alberta 

T5J  4L4  427-2225 


Northern  Alberta  Development  Council 


Bag  900-14 

#206,   9621  -  96th  Ave. 
Peace  River,  Alberta 

T8S  1T4  624-6274 


Alberta  Recreation  and  Parks 

Regional  Offices 


Box  747 

4926  -  1st  Ave. 
Edson,  Alberta 

TOE  OPO  723-8227 


Box  1454 

5025  -  49th  Ave. 

St.   Paul,  Alberta 

TOA  3A0  645-6353 


Alberta  Recreation  and  Parks  (cont.) 


Box  1078 

4917  -  53rd  Ave. 

High  Prairie,  Alberta 

TOG  lEO  523-4561 


#1701  Provincial  Building 
10320  -  99th  St. 
Grande  Prairie,  Alberta 

T8V  6J4  538-5300 


Bag  900-11 

3rd  Floor,  9621  -  96th  Ave. 
Peace  River,  Alberta 

T8S  1T4  624-6295 


Regional  Planning  Commissions 

MacKenzie  Regional  Planning  Commission 
Box  450 

Berwyn,  Alberta 

TOE  OEO  338-3862 


South  Peace  Regional  Planning  Commission 
200  Windsor  Court 
9835  -  101st  Ave. 
Grande  Prairie,  Alberta 

T8V  0X6  532-0988 


Yellowhead  Regional  Planning  Commission 
Box  245 

Onoway ,  Alberta 

TOE  IVO  967-2249 


Statistics  Canada 


#215,  11010  -  101st  St. 
Edmonton,  Alberta 
T5H  4C5 


1-800-282-3907 


APPENDIX  B 


Helpful  Hints  for  Volunteer  Survey  Takers-^^ 

1.  Relax.  Remember  that  this  is  a  community  survey  developed  by  community 
members  for  community  purposes. 

2.  Identify  yourself.  State  your  first  name  and  show  your  identification. 

3.  Invite  people  to  participate.  They  are  your  fellow  residents  and  their 
participation  is  important  but  voluntary. 

4.  Provide  only  the  information  you  are  sure  of.  You  don't  have  to  answer 
all  questions;  direct  people  to  other  sources  of  information. 

5.  Encourage  ideas.  You  do  not  need  to  defend  or  criticize  anyone  or  any 
service . 

6.  Help  people  to  express  themselves.  The  goal  is  to  get  their  ideas  out 
-  not  promote  yours . 

7.  Try  to  be  aware  of  hesitations  or  uncertainties.  Listen  for  what 
people  may  be  trying  to  express.  Check  if  they  have  had  any  problems 
with  the  form. 

8.  Be  friendly  and  sociable.  This  does  not  mean  you  need  to  spend  a  great 
deal  of  time  with  each  person,  nor  that  you  need  to  go  into  the  home. 
Use  your  best  judgement. 

9.  Don't  gossip.  It  is  not  appropriate  to  talk  about  the  other  homes  you 
have  been  in  or  tell  what  other  people  have  said. 

10.  Help  fill  out  survey  forms  if  asked.  Some  people  may  find  it  difficult 
to  do  the  survey  and  will  ask  for  help. 

11.  If  you  feel  uncomfortable,  have  someone  accompany  you. 

12.  Let  someone  know  exactly  where  you  are  going  when  you  deliver  and  pick 
up  the  forms . 

13.  Let  people  know  that  you  have  nothing  to  sell.  Many  groups  use  surveys 
as  a  lead-in  for  their  real  purpose. 

14.  Be  quietly  enthusiastic  about  the  survey.   It  is  for  your  community. 

15.  Quietly  and  politely  take  your  leave  if  someone  becomes  abusive  or 
does  not  wish  to  take  part. 

16.  Review  each  survey  form  after  you  receive  it  to  see  that  it  is 
complete.  Your  interest  is  not  in  the  answers  but  in  completeness. 
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17 .  Make    no    personal    connnitments    regarding  results .  Refer  people  to  the 
newspaper  or  the  town  office. 

18.  If    you    have    any  questions  or  problems,  call  your  co-ordinator  or  the 
town  office. 

19.  Make  one  callback  if  people  are  not  at  home.  Do  not  go  back  often. 

20.  Make    notes    of    your    observations.     You  will  hear  and  see  things  that 
will  help  us  understand  the  responses. 

*      As      taken      from      the      Beaverlodge    Community    Survey:     Fresh  Start 
Consultants  Ltd.,  June,  1985. 


APPENDIX  C 


Terms  and  Definitions 

The  following  is  a  select  list  of  terms  as  defined  in  the  Survey  Research 
Manual  produced  by  Alberta  Recreation  and  Parks.  See  the  bibliography  for 
more  detail. 

Bias : 

A  biased  question  is  one  that  influences  people  to  respond  in  a  way 
that  does  not  accurately  reflect  their  position  on  the  issues.  Some 
people  are  aware  of  the  bias  and  may  be  affected  negatively  by  it,  so 
they  may  not  answer  the  question  truthfully.  Other  people  may  be 
unaware  of  the  bias  and  may  then  be  influenced  to  respond  in  the 
direction  encouraged  by  the  wording  of  the  question  or  the  gestures  of 
the  interviewer. 

Closed- Ended  Questions: 

A  closed-ended  question  presents  a  problem  or  issue  and  provides 
alternative  answers  from  which  the  respondent  can  choose  the  answer 
that  best  reflects  the  respondent's  situation.  The  answer  that  the 
respondent  can  choose  from  should  be  mutually  exclusive  and 
exhaustive . 

Closed-ended  questions  are  quite  easy  to  code.  There  are  many  types  of 
closed-ended  questions. 

1.  Multiple  Choice:  Several  choices  of  answers  are  listed.  The 
respondents  record  their  answers  by  placing  a  check  mark  or 
number  in  the  appropriate  blank,  or  by  circling  the  correct 
words . 

2.  Checklists:  Checklists  are  used  when  more  than  one  answer  may  be 
correct.  Checklists  indicate  the  presence  or  absence  of 
something. 

3.  Ranking:  The  respondents  must  arrange  all  the  given  answers  in 
order  according  to  some  specified  level. 

Codebook: 

A  codebook  is  a  document  that  describes  the  location  of  items  from  the 
questionnaire  in  the  survey  data  file  and  the  specific  labels  that 
make  up  those  items .  A  codebook  acts  as  a  guide  for  coders  as  they 
prepare  questionnaire  responses  for  coding  and  for  locating  items  in 
data  files  during  the  analysis. 

Coding: 

Coding  is  used  to  assign  numbers  to  identify  responses  and  response 
categories  to  make  the  task  of  tabulation  easier.  Coding  may  be  done 
manually  on  paper  for  hand  tabulation  or  prepared  for  computer 
analysis  by  keypunching  the  codes  onto  cards  or  typing  the  codes  into 
a  computer  terminal  to  transfer  onto  a  magnetic  tape. 
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Confidence  Level: 

The  practitioners  can  express  the  accuracy  of  the  sample  statistics  in 
terms  of  their  level  of  confidence  that  the  statistics  will  fall 
within  a  specified  interval.  For  example,  '95%  confidence'  is  often 
used. 

Confidentiality  and  Anonymity: 

An  anon3niious  study  is  one  in  which  nobody  (not  even  the  practitioner) 
can  connect  returned  questionnaires  to  the  names  of  those  completing 
them.  A  study  is  confidential  when  the  practitioner  knows  who  has 
responded  to  each  questionnaire  and  yet  promises  not  to  reveal  this 
information  to  other  people. 

Cover  Letter: 

Cover  letters  should  be  short  and  to  the  point  and  accompany  any 
survey  sent  through  the  mail  or  hand- delivered.  The  cover  letter 
should  include:  the  purpose,  objectives  and  rationale  of  the  study;  a 
description  of  how  the  persons  were  selected,  a  statement  of  the  level 
of  confidentiality  and/or  anonymity;  an  introduction  of  the 
researcher;  identification  of  the  sponsoring  organization;  deadline 
date;  instructions  for  returning  the  questionnaire  if  necessary;  and  a 
"thank  you'  to  the  respondent. 

Cross - tabulation : 

Cross- tabulations  are  used  to  examine  the  number  of  cases  that  occur 
jointly  in  two  or  more  categories  by  integrating  the  response  of  two 
or  more  questions.  Cross- tabulations  explain  rather  than  describe 
data. 

Exhaustive : 

The  practitioner  should  try  to  include  all  possible  answers  to  a 
question.  If  a  practitioner  feels  he  has  left  out  some  possible 
answers,  he  should  include  a  'don't  know'  or  'other  ,  please  specify' 
category,   so  that  every  respondent  can  answer. 

Filtering  Questions: 

Filtering  questions  are  those  which  direct  some  but  not  all 
respondents  to  skip  one  or  more  questions  on  the  answer  they  provide. 
Special  instructions  are  required  for  filtering  questions. 

Follow-up  Letters: 

Follow-up  postcards  or  letters  constitute  one  of  the  best  methods  for 
increasing  the  response  rate.  Generally  two  follow-up  letters  follow 
the  questionnaire  in  two  or  three  weeks.  The  first  follow-up  is  a 
letter  that  encourages  those  people  who  have  not  responded  to  do  so 
and  thank  those  who  have  responded.  The  second  follow-up  should  also 
include  another  questionnaire.  Both  follow-up  letters  should  include 
basically  the  same  material  as  the  cover  letter. 


Leading  Questions: 
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Leading  questions  are  those  that  are  worded  in  a  way  that  strongly 
influences  the  respondents  to  give  a  certain  answer.  They  lead  the 
respondents  to  a  particular  reply.  Leading  questions  do  not  elicit 
accurate  answers . 

Literature  Review: 

A  review  of  the  literature  on  the  specific  research  topic  should  be 
completed  to  determine  what  information  is  available  and  what 
information  is  not  available.  A  literature  review  can  aid  the 
practitioner  on  previous  methods  of  data  collection  and  areas  that 
have  or  have  not  been  researched.  Sources  of  information  are 
libraries,   agencies  and  statistics. 

Loaded  Words: 

Loaded  words  are  those  which  spark  immediate  positive  or  negative 
feelings  in  the  respondents.  The  danger  is  that  the  respondents  will 
react  more  to  the  words  than  to  the  question. 

Mutually  Exclusive: 

The  categories  in  a  question  should  be  clear  and  not  overlap.  In  some 
cases,  questions  are  worded  in  a  way  that  requires  respondents  to  give 
more  than  one  answer  when  only  one  is  required. 

Open-end  Questions: 

Open-ended  questions  allow  the  respondents  to  answer  with  their  own 
words.  Open-ended  questions  are  best  used  in  the  exploratory  or  design 
stages  or  when  studying  complex  issues  such  as  attitudes  and  opinions. 
Open-ended  questions  do,  however,  present  problems  when  it  is  time  to 
code , 

Pre -tests: 

In  pre -testing,  the  practitioner  sends  the  questionnaire  to  a  sample 
of  people  as  similar  as  possible  to  the  people  who  will  be  receiving 
the  actually  questionnaire.  The  practitioner  also  sends  copies  to 
other  people,  such  as  experts  in  the  research  field. 

Random  Sampling: 

A  random  sample  is  defined  as  a  sample  which  has  been  selected  from 
the  population  by  a  process  which  assures  that  each  possible  sample  of 
a  given  size  has  an  equal  chance  of  being  selected,  and  that  all  the 
members  of  the  population  have  an  equal  chance  of  being  selected  into 
the  sample. 
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Respondents : 

Respondents  are  those  who  volunteer  their  time  to  cooperate  with  the 
practitioner  by  providing  information  about  themselves  or  knowledge 
about  certain  issues.  The  practitioner's  search  for  information  should 
never  harm  the  respondents  in  any  way. 

Response  Rate: 

To  have  the  most  representative  survey,  the  response  rate  should  be 
100%.  However,  the  response  rate  is  often  much  lower.  When  the 
questionnaire  is  dropped  off  and  picked  up,  if  the  response  rate  is 
between  30  and  40%,  it  is  considered  to  be  good.  Unless  a  high 
response  rate  is  obtained,  the  study  results  cannot  be  assumed  to  be 
representative . 

Sample : 

A  sample  is  a  subset  of  the  population.  In  an  experiment,  for 
economical  reasons ,  the  practitioner  usually  collects  data  on  a 
smaller  group  of  subjects  than  the  entire  population.  The  smaller 
group  is  called  the  sample. 

Surveys : 

Surveys  are  useful  for  examining  things  that  are  not  observable,  such 
as  opinions  and  attitudes,  as  well  as  for  obtaining  descriptive 
information  about  the  respondents .  There  are  four  types  of  surveys 
that  practitioners  can  use  in  their  studies. 

1.  Face -to -Face  Interview:  A  face -to -face  interview  involves  a 
meeting  between  a  respondent  and  interviewer  who  records  answers 
to  the  survey  questions. 

2.  Telephone  Interview:  In  a  telephone  interview,  the  respondent  is 
reached  by  telephone  and  the  interviewer  records  the  answers  to 
the  questions. 

3.  Self -Administered  Questionnaires:  In  a  self -administered 
questionnaire,  the  respondent  is  responsible  for  understanding 
the  instructions  and  questions  and  recording  his  answers. 

4.  Public  Meeting: Public  meetings  are  open  to  all  those  affected  by 
the  issue  under  study.  It  is  an  opportunity  to  both  give  and 
receive  information,  to  discuss  issues  and  to  reach  an  agreement. 
This  is  an  informal  method  of  gathering  information  and  can  only 
be  analyzed  by  recording  and  examining  the  content  of  the 
discussions . 

Tables : 

Tables  cross -classify  two  variables  into  rows  and  columns.  A  reader 
should  be  able  to  understand  a  table  without  referring  to  the  text. 
Tables  must  have  complete  titles  and  headings  to  aid  the  reader  in 
understanding  what  the  tables  mean. 
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